Enterprise IT Context for the CTO

Bob Gourley

Subscribe to Bob Gourley: eMailAlertsEmail Alerts
Get Bob Gourley via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn

Related Topics: Java Developer Magazine, Big Data on Ulitzer

Blog Feed Post

How to Turn Raw Data into Intelligence

The “transform” stage of “extract, transform, load” rarely gets the spotlight in the Big Data revolution,

The T in ETL, or the “transform” stage of “extract, transform, load” data process, rarely gets the spotlight in the Big Data revolution, but it’s one of the most challenging and important elements in turning raw data into intelligence. Pulling entries from various logs, for example, is useless unless you transform the dates and times into a standard timestamp. Capturing, harvesting, extracting, transforming and loading text from the web can be even trickier, with lots of hidden information that can be very relevant to analysis. Consider, for example, a page like eBay’s that uses green and red color coding to indicate whether you have the highest bid. Advanced capabilities are required to harvest this type of information.

Kapow Katalyst offers the industry’s most robust, comprehensive data transformation and normalization capabilities to allow you to work with the Web’s unstructured data. Katalyst can handle different types, formats, spacing, binary, arithmetic operations, HTML, XTML, tags, and more. All of this can be done conditionally with unlimited if-then/else conditions for flexibility, and an ability to invoke Java or .NET or other services as required.

All of this logic can be programmed through Katalysts’s Design Studio, a visual integrated development environment (IDE). The transformations can then be tested in real time and shared with other members of the team.

You can learn more about Kapow’s transformation capabilities on the Katalyst Platform’s Business Rules and Data Transformations page.

More Stories By Bob Gourley

Bob Gourley writes on enterprise IT. He is a founder of Crucial Point and publisher of CTOvision.com

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.