How to make Hadoop logfile analysis fun & interesting

| 1 Comment
| More

21e12devwev.jpgThe heady world of server log analysis kicks up another gear this week with new products proffered forth from XpoLog Ltd, the company that says it "invented" augmented search for IT log analysis.

What's the augmentation and why is it interesting?

We're glad you asked -- this is a process by which DevOps professionals can discover hidden:

• errors,
• anomalies,
• problems and,
• patterns...

... that may be hiding inside IT log data.

What is IT log data or a logfile?

This is a file that records "events" occurring throughout an operating system or software application (in the case of XpoLog this software is focused on open source Hadoop) and it can also incorporate message information between users in a network -- a list of other log types can be found here if you need bedtime reading.

Augmented auto-detected intelligence

6y5tgrefvv.jpg

XpoLog is aiming to bring more to the party than plain old log searches and now offers what it calls search with "augmented auto-detected intelligence" based on user search context.

We digress, back to the news... XpoLog Augmented Search 5.0 brings XpoLog's troubleshooting capabilities to the Hadoop platform.

The company states the obvious but still pertinent factor at play here i.e. testing applications on Hadoop (a large-scale, distributed data processing platform) isn't a trivial task.

Pattern and anomaly detection

"XpoLog adds intelligence to log file search context with semantic analysis, and pattern and anomaly detection (to uncover insights and trends into application problems, systems, and user behaviour)," said XpoLog VP Solutions Omry Koschitzky.

"This helps users analyze problems within the Hadoop infrastructure and applications that run on the platform. It offers visibility into the distributed architecture, automatically triaging issues and errors for severity, and presenting results in a dashboard interface," he added.

The company has made the XpoLog platform free for processing up to 1 gigabyte of log data per day.

More fun and interesting than you thought?

1 Comment

Check out a new Cloud Log Monitoring & Management Platform: OohLaLog (http://www.oohlalog.com). It offer broad support for apps, DBs, and systems including Hadoop. With it's non-intrusive architecture along with features like custom alerts and counters, devOPs and Developers can now discover & resolve issues 75% faster with zero impact on their production applications. Try it for Free! http://www.oohlalog.com

Leave a comment

(You will need either to sign in or enter a valid email address to comment.)

About this Entry

This page contains a single entry by Adrian Bridgwater published on June 2, 2014 9:25 AM.

What is a network-independent mobile application? was the previous entry in this blog.

Do you know your OpenStack history? is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

Categories

Archives

-- Advertisement --