Sioux Falls, SD – December 16, 2014 – BrightPlanet, a leader in providing scalable Web harvesting technology, and Mahindra Special Services Group (MSSG), India’s leading corporate security risk consulting firm, have developed a technology partnership to offer open source intelligence (OSINT) solutions for risk management to customers seeking them in India.
The technology partnership will combine BrightPlanet’s patented ability to harvest and enrich data from the Web at scale with Mahindra’s expertise in the risk management sector. The partnership will bring a first of its kind solution to the market.
Welcome to our second post in our two-part series which answers some of the frequently asked questions we get from visitors and customers. Last week, we posted Part 1 which focused on questions related to the Deep Web and how we get data from it. This post focuses on questions about Big Data and how we enrich and structure it from the Deep Web.
BrightPlanet announces exclusive partnership with AFIMAC to help companies identify and address domestic and global security risks before they become crises
Sioux Falls, SD – December 4, 2014 – Identifying potential internal and external threats and having a mechanism to mitigate them before they become reality is the primary function of a joint partnership announced today between BrightPlanet, the leading Deep Web harvesting and Big Data analytics collection company, and AFIMAC, a global leader in crisis and risk management services.
Our visitors ask us lots of challenging questions about a variety of topics relating to Big Data and the Deep Web. Some example questions include: what the Deep Web is, what data is available on it, how big is it, etc. There are some questions that we get so frequently we decided to gather those questions and resources in a series of posts to help answer them. You’ll find our quick answers to a variety of questions below with a link to a more in-depth blog posting for each question that we hope you’ll find as valuable as we do.
We’ve broken these questions up in a two part series. Part 1 focuses on questions related to the Deep Web and how we get data from it. Part 2 will focus on questions about Big Data and how we enrich and structure Big Data. Continue reading
Over 13 years ago, we released a study that revealed search engines were missing the vast majority of content online in a portion of the Internet called the Deep Web. The study titled, “The Deep Web: Surfacing Hidden Value” revealed that the estimated size of the Deep Web was 400-500 times larger than that of the Surface Web and only .03% or 1 in 3,000 Web pages were actually being indexed by a traditional search engine.
A lot has changed in the way the Web works in the last 13 years, so much in fact, that it has become near impossible to replicate the 2001 study because of the sheer size of the Web. In today’s blog post, we are going to take a look at why it’s now become impossible to accurately answer the question: ‘How big is the Internet?’
BrightPlanet and Swan Island Networks joint technology partnership to offer a customizable data and security intelligence dashboard for customers.
Sioux Falls, SD – October 28, 2014 – BrightPlanet and Swan Island Networks are excited to announce a joint technology partnership to offer a customizable data and security dashboard for customers. The partnership allows both companies to leverage each other’s complimentary technologies.
BrightPlanet will be utilizing its harvesting technology to collect and structure publicly available data from the Web to create new data feeds and channels for direct integration into Swan Island Networks’ TIES for Microsoft CityNext and TX360 agile situational intelligence product offerings. The partnership will open up additional channels and analytic opportunities to Swan Island Networks’ public sector and enterprise customers.
THE SERIES HAS COMPLETED. DOWNLOAD THE WEBINAR RECORDING.
Over the past few months, we’ve had increased interest in BrightPlanet’s technology and individuals wanting to learn more about how we harvest and structure Big Data from the Deep Web.
To help our readers and followers learn more about BrightPlanet, we are excited to announce our Deep Web University Webinar Series that will feature reoccurring, free, live webinars to help our followers better understand how we harvest and then structure Big Data from the Web for many uses by end users. We will presenting the same webinar multiple times so you can pick the best date and time for you.
Last week we highlighted a case study about how an insurance group used our BITS dataset to help a chief actuary improve the underwriting process. We explained how an actuary from an insurance organization is using a dataset of over 9,000 news sources to increase pricing efficiency. Today, we hope to further explain how customers are using our BITS dataset, but this time we’ll explore how a Chief Security Officer is using BITS to help track the outbreak of disease globally.
Earlier this year, to celebrate the 25th anniversary of the Internet, the Pew Research company released the most recent stats about the adoption rates and internet usage of adults living in the United States. See what this means for crime online and law enforcement in this post and in our new whitepaper: Open Source Intelligence (OSINT) for Law Enforcement.
Six months have passed since we made our Big Industry Threats dataset, also known as BITS, available to customers. BITS, our flagship dataset, contains a collection of over 11 million news stories from the past 18 months spanning 9,000 global sources with over 93 languages. Our customers found a number of different uses for our BITS dataset including risk managers tracking disease outbreaks and insurance professionals improving the underwriting process.
In today’s post, we’re going to explain how we helped a chief actuary for a major insurance company improve her data to help increase efficiency and accuracy of pricing homeowners insurance policies for customers overseas.