BrightPlanet and Mahindra SSG Team Up to Bring New OSINT Solutions for Corporate Security and Risk Management to India

Sioux Falls, SD – December 16, 2014 – BrightPlanet, a leader in providing scalable Web harvesting technology, and Mahindra Special Services Group (MSSG), India’s leading corporate security risk consulting firm, have developed a technology partnership to offer open source intelligence (OSINT) solutions for risk management to customers seeking them in India.

The technology partnership will combine BrightPlanet’s patented ability to harvest and enrich data from the Web at scale with Mahindra’s expertise in the risk management sector. The partnership will bring a first of its kind solution to the market.

Continue reading »

Posted in Deep Web and Big Data, Intelligence Community | Tagged , , |

Common Deep Web and Big Data Questions Answered – Part 2

Welcome to our second post in our two-part series which answers some of the frequently asked questions we get from visitors and customers. Last week, we posted Part 1 which focused on questions related to the Deep Web and how we get data from it. This post focuses on questions about Big Data and how we enrich and structure it from the Deep Web.

Continue reading »

Posted in Deep Web and Big Data | Tagged , , , |

BrightPlanet Partners with Leading Security Firm AFIMAC Global to Create OSINT Solution for Risk Management

BrightPlanet announces exclusive partnership with AFIMAC to help companies identify and address domestic and global security risks before they become crises

Sioux Falls, SD – December 4, 2014  – Identifying potential internal and external threats and having a mechanism to mitigate them before they become reality is the primary function of a joint partnership announced today between BrightPlanet, the leading Deep Web harvesting and Big Data analytics collection company, and AFIMAC, a global leader in crisis and risk management services.

Continue reading »

Posted in Deep Web and Big Data, Intelligence Community |

Common Deep Web and Big Data Questions Answered – Part 1

Our visitors ask us lots of challenging questions about a variety of topics relating to Big Data and the Deep Web. Some example questions include: what the Deep Web is, what data is available on it, how big is it, etc. There are some questions that we get so frequently we decided to gather those questions and resources in a series of posts to help answer them. You’ll find our quick answers to a variety of questions below with a link to a more in-depth blog posting for each question that we hope you’ll find as valuable as we do.

We’ve broken these questions up in a two part series. Part 1 focuses on questions related to the Deep Web and how we get data from it. Part 2 will focus on questions about Big Data and how we enrich and structure Big Data. Continue reading »

Posted in Deep Web and Big Data | Tagged , , , |

How Big is the Internet?

Over 13 years ago, we released a study that revealed search engines were missing the vast majority of content online in a portion of the Internet called the Deep Web. The study titled, “The Deep Web: Surfacing Hidden Value”  revealed that the estimated size of the Deep Web was 400-500 times larger than that of the Surface Web and only .03% or 1 in 3,000 Web pages were actually being indexed by a traditional search engine.

A lot has changed in the way the Web works in the last 13 years, so much in fact, that it has become near impossible to replicate the 2001 study because of the sheer size of the Web. In today’s blog post, we are going to take a look at why it’s now become impossible to accurately answer the question: ‘How big is the Internet?’

Continue reading »

Posted in Deep Web and Big Data | Tagged , , , , |

BrightPlanet Announces Partnership with Swan Island Networks

BrightPlanet and Swan Island Networks joint technology partnership to offer a customizable data and security intelligence dashboard for customers.

Sioux Falls, SD – October 28, 2014 –  BrightPlanet and Swan Island Networks are excited to announce a joint technology partnership to offer a customizable data and security dashboard for customers. The partnership allows both companies to leverage each other’s complimentary technologies.

BrightPlanet will be utilizing its harvesting technology to collect and structure publicly available data from the Web to create new data feeds and channels for direct integration into Swan Island Networks’ TIES for Microsoft CityNext and TX360 agile situational intelligence product offerings. The partnership will open up additional channels and analytic opportunities to Swan Island Networks’ public sector and enterprise customers.

Continue reading »

Posted in Deep Web and Big Data | Tagged , , , , |

Announcing Deep Web University Webinar Series: How to Harvest and Structure Big Data from the Deep Web

THE SERIES HAS COMPLETED. DOWNLOAD THE WEBINAR RECORDING.

Over the past few months, we’ve had increased interest in BrightPlanet’s technology and individuals wanting to learn more about how we harvest and structure Big Data from the Deep Web.

To help our readers and followers learn more about BrightPlanet, we are excited to announce our Deep Web University Webinar Series that will feature reoccurring, free, live webinars to help our followers better understand how we harvest and then structure Big Data from the Web for many uses by end users. We will presenting the same webinar multiple times so you can pick the best date and time for you.

Continue reading »

Posted in Case Studies, Deep Web and Big Data | Tagged , , , |

Using Web Data to Visualize and Track Disease Outbreak for Global Security

Last week we highlighted a case study about how an insurance group used our BITS dataset to help a chief actuary improve the underwriting process.  We explained how an actuary from an insurance organization is using a dataset of over 9,000 news sources to increase pricing efficiency. Today, we hope to further explain how customers are using our BITS dataset, but this time we’ll explore how a Chief Security Officer is using BITS to help track the outbreak of disease globally.

Continue reading »

Posted in Case Studies, Deep Web and Big Data | Tagged , , , |

[WHITEPAPER] Open Source Intelligence (OSINT) for Law Enforcement

Earlier this year, to celebrate the 25th anniversary of the Internet, the Pew Research company released the most recent stats about the adoption rates and internet usage of adults living in the United States. See what this means for crime online and law enforcement in this post and in our new whitepaper: Open Source Intelligence (OSINT) for Law Enforcement.

Continue reading »

Posted in Law Enforcement, White Papers and Publications | Tagged , , , |

Using Big Data from the Web to Improve the Underwriting Process

Six months have passed since we made our Big Industry Threats dataset, also known as BITS, available to customers. BITS, our flagship dataset, contains a collection of over 11 million news stories from the past 18 months spanning 9,000 global sources with over 93 languages. Our customers found a number of different uses for our BITS dataset including risk managers tracking disease outbreaks and insurance professionals improving the underwriting process.

In today’s post, we’re going to explain how we helped a chief actuary for a major insurance company improve her data to help increase efficiency and accuracy of pricing homeowners insurance policies for customers overseas.

Continue reading »

Posted in Case Studies, Deep Web and Big Data | Tagged , , , , |