Deep Web Search: What’s Possible

Trying to wrap your mind around the Deep Web is like trying to imagine there is a whole other world with even more resources and living beings than on Earth. It’s a territory unknown to most, yet has potential for everyone.

What is the Deep Web?

The Deep Web is sometimes referred to as the “invisible web,” or the “hidden web,” all of which reference the unreachable pages on the Internet. These pages are unreachable because Web crawlers in search engines’ databases cannot index them.The Deep Web refers to content on the World Wide Web that is not catalogued by standard search engines. To add perspective, the portion of the World Wide Web that can be picked up by a standard search engine, such as Google, is known as the “surface web.”

Continue reading »

Posted in Deep Web and Big Data | Tagged , , |

Why Law Enforcement Needs to Monitor Social Media

The Internet is the most popular outlet of communication with billions of messages exchanged online every day, but not all of them are legal. Easy access, speed, and wide message reach through social media make the Internet an ideal platform for letting people know what you are planning, coordinating, or selling.

Dealers advertise illegal drugs, revolutionaries plot potentially violent demonstrations, criminals message other criminals, and unknowing witnesses describe crimes happening in front of them.  Monitoring these events in real-time through social media helps transform law enforcement from a reactionary service to a collection of proactive crime stoppers.

Continue reading »

Posted in Deep Web and Big Data, Intelligence Community, Law Enforcement | Tagged , , , |

What is a Deep Web harvest?

Far below the surface of the Internet lies the Deep Web. Google can’t take you there, nor can any other standard search engine. The Deep Web is full of valuable research, content and data sets too large for the average Internet user to analyze one click at a time. The Deep Web can be accessed only by searching a website’s search box, thereby querying the database behind a Deep Web website. Without access to the Deep Web, the user will not find content on the Internet that isn’t explicitly linked to.

Continue reading »

Posted in Deep Web and Big Data, Financial Industry, Healthcare | Tagged , , , , , , , |

[Whitepaper] Exploiting Big Data from the Deep Web

The Big Data explosion is impossible to ignore. The problem is 90 percent of new data is unstructured, making it challenging for analytics to create intelligence. Most of this unstructured data is hidden from regular web searches in what is called the Deep Web. U.S. intelligence agencies have exploited Big Data from the Deep Web for years; only recently has this technology been available commercially.

Continue reading »

Posted in Deep Web and Big Data, Intelligence Community, White Papers and Publications | Tagged , , , , , , |

How Big Data Broke up Carderprofit

The recent arrests in the Carderprofit scheme have government agencies buzzing about the benefits of Big Data mining provided by companies like BrightPlanet. Without the proper tools and deep web intelligence necessary to infiltrate this organization, these hackers would still be at large today.

Continue reading »

Posted in Deep Web and Big Data, Intelligence Community, Law Enforcement | Tagged , , , , |

Big Data Mining: Harvesting the Deep Web

Tracking online activity is a difficult business. People move more and more of their lives to the world wide web, and there is thus a wealth of information out there that people have exposed, whether intentionally or unintentionally. With this comes all new methods of tracking down wrongdoing–every day, people use online mediums to communicate about or coordinate illegal activities. But the internet is a big place, and tracking down these cases–performing the necessary Big Data Mining–is not so simple as just typing a few keywords into Google, or another search engine.

Continue reading »

Posted in Deep Web and Big Data | Tagged , , , |