Text Extraction / Web Page Cleaning

CrawlingIndia provides easy-to-use mechanisms to extract page text and title information from any web page.

A HTML page cleaning facility is provided, which normalizes / cleans HTML content (removing ads, navigation links, and other unimportant content), enabling extraction of only the important article text.

Doing Market Research with Social Media

Observational social media research

involves analyzing social media data without intervention or interaction from the researcher.  In this mode of research, you search for, look at, collect, synthesize, and analyze data that exist in the social media sphere (blogs, newsgroups, forums, message boards, and microblogs).  The goal is to measure and gauge public awareness and sentiment of issues, products, or brands.  Not long ago I headed up a panel of industry thought leaders that focused on this type of social media research, and what it might mean for our industry.