The Future of Intelligent Middleware

The Future of Intelligent Middleware, IBM Research at Impact 2013 Conference

Contextual analytics
Continuous insight
Key technical problems: unstructured, unstructured, semi-structured; have been working on scale OR performance, not both, which will happen in a clustered environment

Why is contextual analytics important?
An urgent need to understand information, particularly asynchronous ones

Scenario: financial company with transactional credit card swipes, want to know as fraudulent or not
Fraud detection could be on scoring, but could have gang using card quickly over a short period of time
Scenario: Homeland security
Scenario: In-store video analytics
Scenario: Healthcare, sensors on patient

Want improved time to decision-making
Think of Continuous Insight as a Platform, with an engine that could scale up

This is an application server redux: not just three tier, now want transactions in memory not as a single JVM, but as in memory clustered
Challenge is analytics across JVMs
Would use MapReduce and Hadoop, except those are for scaling up, not in a cluster

Today, can have sales pipeline management, sales exec wants to see SmartSeller with Sales Challenge Alerts

Demo trains with hidden Markov Model

Started project on scale out computation, previously funded by DARPA, open source language called X10, for place-centric, asynchronous computing
Generates both C++ and Java
Will have programmer deal with place and asynchrony
Don’t have to code in X10, have a global programming model above that

Next steps to make this work: what is a good way to provide an analytics language at scale?


David Ing blogs at , photoblogs at , and microblogs at . See .

Posted in status

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Beyond this microblog
This content is syndicated to Twitter. For professional perspectives, look to Coevolving Innovations; for a photoblog, look to Reflections, Distractions.
  • 2017/03 Moments March 2017
    Toronto, Ontario; Santa Clara, California; Milpitas, California; San Jose, California; Oakland, California; Hayward, California; Mountain View, California; Palo Alto, California; San Francisco, California; Mountain View, California; Half Moon Bay, California, Pescadero, California; Santa Cruz, California; Tokyo, Japan
  • 2017/02 Moments February 2017
    Toronto, Ontario; Mississauga, Ontario; London, Ontario
  • 2017/01 Moments January 2017
    Toronto, Ontario. (A whole month without leaving town, since Don Mills and Scarborough are Metropolitan Toronto)
  • 2016/12 Moments December 2016
    Helsinki; Finland; London, England; Dublin, Ireland; Toronto, Ontario; Fairfield, Iowa
  • 2016/11 Moments November 2016
    Markham, Ontario; Toronto, Ontario; Scarborough, Ontario; London, Ontario; Montreal, Quebec; Brussels, Belgium; Woluwe Saint Pierre, Belgium; Amersfoort, Netherlands; Hameenlinna, Finland
  • 2016/10 Moments October 2016
    Toronto, Ontario; Richmond Hill, Ontario; Don Mills, Ontario; San Francisco, California; Oakland, California; Berkeley, California; San Jose, California; Mountain View, California; Las Vegas, Nevada; Los Gatos, California
I welcome your e-mail. If you don't have my address, here's a contact page.
%d bloggers like this: