When it comes to harvesting open-source Big Data from the Deep Web, stakeholders within every step of the data chain are concerned about the legal issues surrounding privacy and civil liberties.
Professionals in law enforcement and the intelligence community, in particular, are concerned with protecting privacy, civil rights, and civil liberties. Below are two helpful links from the Institute for Intergovernmental Research and U.S. Government Printing Office regarding criminal intelligence gathering.
It’s an election year and campaign season is in full swing. Commercials are on every television and radio station, polling cold-calls are being made, and rallies are creating buzz. The world of politics is large, competitive, and fast-paced. Real-time updates and information published on non-indexed websites can make it virtually impossible to stay on top of political research. Even with the best and brightest campaign team, rumors on the newswire or competitive intelligence can easily fly under the radar. Continue reading
BrightPlanet’s Deep Web Silos are individual repositories for topic-specific content, and are updated with new and relevant information from the Deep Web Harvester in real-time. Each one is filled with high-quality Deep Web resources – databases, RSS feeds, and more – that lie beyond the reach of traditional search engines. They also include standard analytical tools like raw data views, topic clustering, and link analysis. Additional custom analytical modules can easily be added to meet your reporting needs. Continue reading
The Deep Web Monitor is a thin client solution that allows you to monitor and harvest tweets, blogs, RSS feeds, surface sites and Deep Web Sites. With the Monitor, YOU define the sources, YOU define the keyword queries, and YOU get alerts delivered directly to your email.
The Monitor is easy to use, and starts delivering your Deep Web results as soon as you set up the query. Real-time results can also be geo-located, letting you see exactly where they originated. Best of all, users can save queries and archive and export harvested result sets. The Deep Web Monitor works best for: Continue reading