BrightPlanet Launches Deep Web Data Feeds: Global News Data Feed is First Available Data Feed

BrightPlanet is excited to announce a new product line called Deep Web Data Feeds. Deep Web Data Feeds utilize a data-as-a-service (DaaS) model and give users the ability to leverage unstructured data collected from the Internet that has been enriched and structured through BrightPlanet’s harvesting and enrichment process. The Global News Data Feed is the first available data feed that is ready for access.

Continue reading »

Posted in Deep Web and Big Data | Tagged , , |

Using Big Data from the Deep Web for Financial Compliance, Fraud Detection & Fraud Prevention

In our last posting, we featured two case studies on how our customers are using Big Data from the Deep Web in the insurance and risk management industries. In this post, you’ll learn how customers in the financial service industry are using Web data to help understand exposure to risk and better develop initiatives for institutional compliance related to ‘Know Your Customer’ (KYC).

Continue reading »

Posted in Financial Industry | Tagged , , , , |

Why you should tap into the Deep Web in 2015

It’s no surprise to anyone that the growth and use of the Internet has continued to increase steadily. Over three billion people now have access to the Internet at home or 42% of the global population have the ability to directly access the Internet. The three billion people contribute to the content on the Internet by generating:

In this posting, we cover why you should tap into content on the Web in 2015. We also recap how users of Web data capitalized on harvested and enriched content from the largest known database in existence, the Internet, in 2014.

Continue reading »

Posted in Deep Web and Big Data | Tagged , , |

Using Email Harvesting to Mitigate Risk and Detect Online Fraud  

We spend a lot of time talking about Web data harvesting and collection here on the Deep Web University and often forget to talk about email harvesting and how it can benefit users.

In today’s posting we uncover how we harvest email content and explore two case studies that illustrate how risk managers and security officers are using email harvesting to mitigate risk and detect fraud.

Continue reading »

Posted in Case Studies, Deep Web and Big Data, Intelligence Community | Tagged , , , , , , , |

BrightPlanet and Mahindra SSG Team Up to Bring New OSINT Solutions for Corporate Security and Risk Management to India

Sioux Falls, SD – December 16, 2014 – BrightPlanet, a leader in providing scalable Web harvesting technology, and Mahindra Special Services Group (MSSG), India’s leading corporate security risk consulting firm, have developed a technology partnership to offer open source intelligence (OSINT) solutions for risk management to customers seeking them in India.

The technology partnership will combine BrightPlanet’s patented ability to harvest and enrich data from the Web at scale with Mahindra’s expertise in the risk management sector. The partnership will bring a first of its kind solution to the market.

Continue reading »

Posted in Deep Web and Big Data, Intelligence Community | Tagged , , |

Common Deep Web and Big Data Questions Answered – Part 2

Welcome to our second post in our two-part series which answers some of the frequently asked questions we get from visitors and customers. Last week, we posted Part 1 which focused on questions related to the Deep Web and how we get data from it. This post focuses on questions about Big Data and how we enrich and structure it from the Deep Web.

Continue reading »

Posted in Deep Web and Big Data | Tagged , , , |

BrightPlanet Partners with Leading Security Firm AFIMAC Global to Create OSINT Solution for Risk Management

BrightPlanet announces exclusive partnership with AFIMAC to help companies identify and address domestic and global security risks before they become crises

Sioux Falls, SD – December 4, 2014  – Identifying potential internal and external threats and having a mechanism to mitigate them before they become reality is the primary function of a joint partnership announced today between BrightPlanet, the leading Deep Web harvesting and Big Data analytics collection company, and AFIMAC, a global leader in crisis and risk management services.

Continue reading »

Posted in Deep Web and Big Data, Intelligence Community |

Common Deep Web and Big Data Questions Answered – Part 1

Our visitors ask us lots of challenging questions about a variety of topics relating to Big Data and the Deep Web. Some example questions include: what the Deep Web is, what data is available on it, how big is it, etc. There are some questions that we get so frequently we decided to gather those questions and resources in a series of posts to help answer them. You’ll find our quick answers to a variety of questions below with a link to a more in-depth blog posting for each question that we hope you’ll find as valuable as we do.

We’ve broken these questions up in a two part series. Part 1 focuses on questions related to the Deep Web and how we get data from it. Part 2 will focus on questions about Big Data and how we enrich and structure Big Data. Continue reading »

Posted in Deep Web and Big Data | Tagged , , , |

How Big is the Internet?

Over 13 years ago, we released a study that revealed search engines were missing the vast majority of content online in a portion of the Internet called the Deep Web. The study titled, “The Deep Web: Surfacing Hidden Value”  revealed that the estimated size of the Deep Web was 400-500 times larger than that of the Surface Web and only .03% or 1 in 3,000 Web pages were actually being indexed by a traditional search engine.

A lot has changed in the way the Web works in the last 13 years, so much in fact, that it has become near impossible to replicate the 2001 study because of the sheer size of the Web. In today’s blog post, we are going to take a look at why it’s now become impossible to accurately answer the question: ‘How big is the Internet?’

Continue reading »

Posted in Deep Web and Big Data | Tagged , , , , |

BrightPlanet Announces Partnership with Swan Island Networks

BrightPlanet and Swan Island Networks joint technology partnership to offer a customizable data and security intelligence dashboard for customers.

Sioux Falls, SD – October 28, 2014 –  BrightPlanet and Swan Island Networks are excited to announce a joint technology partnership to offer a customizable data and security dashboard for customers. The partnership allows both companies to leverage each other’s complimentary technologies.

BrightPlanet will be utilizing its harvesting technology to collect and structure publicly available data from the Web to create new data feeds and channels for direct integration into Swan Island Networks’ TIES for Microsoft CityNext and TX360 agile situational intelligence product offerings. The partnership will open up additional channels and analytic opportunities to Swan Island Networks’ public sector and enterprise customers.

Continue reading »

Posted in Deep Web and Big Data | Tagged , , , , |