Business Intelligence Provider Pentaho Acquires Interface Shop Webdetails

Analytics, meet visuals. Business intelligence provider Pentaho has bought consulting partner Webdetails, a Portugal-based visual interface development shop.
The acquisition could point to new user interface approaches for intelligence products, as analytics tools move from providing information to becoming easier and faster to use.
Terms of the deal were not announced. Webdetails’ founder Pedro Alves, who is active in Pentaho’s open source community, will become Senior VP for Community at Pentaho. Alves wrote on his blog this week that the daily work for Webdetails 20-person staff “won’t change much,” except for the additional tag of “A Pentaho company.”

Open Source Products

The Orlando, Florida-based Pentaho offers open source business intelligence products that provide data discovery, data integration and predictive analytics, as enterprise and community versions. The products are available on-premises, in the cloud or embedded into applications.
Webdetails' screens.png
Webdetails-created screens
On its website, Pentaho notes “massive, disruptive changes” that it says are transforming analytics. These drivers include the growth of Big Data, the adoption of cloud computing, and the growing expectations arising from the consumerization of IT. The acquisition of Webdetails can be seen as Pentaho’s attempt to bring inside the resources needed to move data-bursting, everywhere-available business analytics toward the ease-of-use expectations that employees increasingly have.

Improving User Experience

Pentaho EVP and COO Doug Johnson said in a statement that “everything about Webdetails perfectly complements our operations as we continue to scale to meet demand fueled by the big data revolution.” He added that Webdetails’ high-end visualization expertise will help to roll out “exceptional visualizations” from Big Data and other data sources.
The analytics company said that it intends to utilize Webdetails to accelerate its R&D plans for improving the user experience of its platform and integration tools, including the range of dashboard visualizations, improving ease-of-use for its Instaview visual development tool, and creating interfaces intended to support novice users.
Webdetails work for Pentaho has included designing plug-ins, such as the Community Tools series that help to manage dashboards and reports. Other Webdetails efforts included work for the Pentaho Marketplace on github, for sharing plug-ins.

Original Source: http://www.cmswire.com/cms/information-management/business-intelligence-provider-pentaho-acquires-interface-shop-webdetails-020648.php

Fighting crime with intelligence

In Richmond, Va., police deployed officers in areas with high past New Year’s Eve crime rates, cutting gunfire incidents by 49 percent and increasing weapons seized by 246 percent. This was accomplished with a third of the officers typically used and led to a savings of $15,000 in overtime for that one night.

In Houston, Texas, an analyst monitoring 9-1-1 calls spotted information about a car on the scene of a Family Dollar Store robbery, one of a recent spate of such robberies. Using partial plates and a brief description, he found the car had previously been charged with moving violations and that the driver wasn’t the registered owner and didn’t live where the vehicle was registered. The analyst found the driver’s address and got it to the officer, who went there immediately and arrested the suspect—solving the series of robberies in under an hour.

In Erlanger, Ky., an officer in the field quickly solved an indecent exposure call from his car by searching past records. On another occasion, when a burglary occurred in a neighboring community close to the city boundary, supervisors immediately knew and sent units to patrol the area, potentially preventing further thefts—without having to add personnel and raise taxes.

These are just some of the stories police in these cities tell about what they are accomplishing with business intelligence technology that provides decision-makers with a 360-degree view of crime and enables them to solve and prevent crime quickly and effectively while containing costs, including reducing overtime.

Predictive Analytics

Seasoned police officers know that weather affects crime. In Richmond, Va., though, even the greenest officer can know exactly how it affects the city’s crime patterns and can respond accordingly. In 2004, Richmond, population 220,000, was ranked the fifth most dangerous city in the United States. The police department implemented a new information system for predicting crime and reduced its violent crime rate by double digits two years in a row. In its first year, the system significantly reduced incident rates of murder (32 percent), rape (20 percent), robbery (3 percent), aggravated assault (18 percent), burglary (18 percent) and auto theft (13 percent). All major crime rates have continued to drop consistently, with homicides dropping by 42 percent and commercial robberies dropping by 45 percent in 2008.

The system, which won Gartner’s 2007 BI Excellence Award, provides a sophisticated data model of criminal activity using elements defined by the Richmond police to predict future criminal behavior. The entire department has easy access to predictive crime analysis, data-mining to correlate past and present data, reporting, and GIS capabilities to view specific types of crime for a given area and perform crime mapping and analysis.

Richmond PD worked with Information Builders for integration, analytics and reporting; with ESRI® for dynamic mapping display; and with Pictometry International Corp. for detailed pictures and dynamic geographical displays of locations and surrounding neighborhoods for reported incidents. They also worked with analytical software vendor SPSS Inc., an IBM company, for data-mining capabilities.

Crime analysts can now correlate present and past data back to five years, analyzing arrest records, motive, and type of crime at a particular location based on the day, time, weather, moon phases, pay days, holidays and city events. Analysts found, for instance, that certain property crimes were better indicators of likely sexual assaults than the presence of convicted sex offenders.

Richmond PD uses this insight to optimize police resources to deter crime. Officers receive the most up-to-date information available, along with a screen of predictions of crime hot spots they can access before a shift. For example, a high rate of robberies occurred on paydays in Hispanic neighborhoods, where fewer people use banks and where customers leaving check-cashing stores were easy targets. Elsewhere, clusters of random-gunfire incidents occurred at certain times of night. To protect these neighborhoods, extra police were deployed when and where incidents were predicted.

Real-Time Crime Center

Houston, the fourth largest city in the United States, has a population of 2.2 million with 5,200 police officers patrolling its 700 square miles. With information as dispersed as its population, the Houston Police Department (HPD) needed a single version of the truth and fast, secure, simple access to accurate, useful data. It met the challenge with a real-time crime center built in less than three months using Information Builder’s business intelligence and enterprise integration solutions for report writing and data access via a dashboard and ESRI for GIS mapping.

Awarded a Vision Award for Business Impact in the category of “Advanced Business Intelligence” by BeyeNETWORK, HPD’s crime center provides real-time data analysis on more than 15 years’ worth of information and quickly disseminates it to the field, focusing the whole organization on its core mission of fighting crime. The system is improving police procedures and officer and community safety, reducing the time to solve crimes, enabling better deployment of officers to hot spots, and using overtime more efficiently.

HPD tied analytics associated with crimes to incident locations, providing insights into specific incidents and trends. For example, those dealing with a crime scene can analyze all the statistics around the area, looking at what has happened within a time frame and even seeing parolees and sex offenders in the area. Users can also zoom in on a neighborhood, block or street, and see houses, cars, yards and fields.

In addition, crime center analysts have real-time access to Houston 9-1-1 calls, where they watch on a rolling screen as calls and messages go between the dispatcher and the car. Analysts work 24/7 analyzing data, generating reports on the fly, and providing information to officers in the field. Recently, for example, the emergency center received a disturbance call, and while the officers were being dispatched to the scene, analysts ran the name, found out the man creating the disturbance was a fugitive, and alerted the officers, who arrived at the scene knowing he was a fugitive and arrested him.

Every manager has access to KPIs and performs analysis. At weekly meetings, the chief, for instance, can ask how many armed robberies happened compared to the previous month in a specific division and access statistics immediately. These meetings are PowerPoint-free, with commanders productively collaborating on strategies and immediately accessing all relevant data.

Integrated, Real-Time Search

As part of the Greater Cincinnati-Northern Kentucky metropolitan region, the Erlanger, Ky., Police Department coordinates with police and fire departments in more than a dozen communities. Recently, the community experienced a 5–10 percent annual increase in calls, stretching police resources to the limit.

To better serve its 17,000 residents with a 45-member force, Erlanger PD created a new real-time information system with integrated search capabilities. The new system enables law enforcement personnel in 10 adjacent police agencies throughout Northern Kentucky, including 150 patrol officers, to share up-to-date information from 19 government agencies. The system combines current crime data from the agencies, linking formerly unrelated information about suspects, incidents, arrests and crimes. It also merges current data with crime records and incident reports stretching back more than five years.

Accessed through a simple Web-based portal interface, the new system provides police with real-time views of incidents, arrests, 9-1-1 calls and other events throughout the dispatch area. Erlanger PD worked with Information Builders, using its WebFOCUS software and ESRI’s geographic information system (GIS) software to create this interactive, real-time crime portal in less than three months.

All cities and agencies connected to the system input their respective Records Management Systems (RMS). Officers can also enter notes into the system directly from the field. Integration technology updates the search index every 15 minutes with crime records from Erlanger’s computer-aided dispatch (CAD) system and RMS. Users search both dynamic BI content and structured and unstructured data sources through the universally known Google search paradigm. By using simple keyword searches, they can locate key facts and then follow links to execute reports and access information in the format of their choice, including Excel, PDF, HTML or XML. With this capability, even if they don’t know exactly what they are looking for or where it is stored, officers can find what they need via a Web browser.

Now it is much easier to detect patterns quickly. In the past, for example, a string of burglaries involving iron and steel became widespread throughout the county without individual police departments recognizing the pattern until some stolen goods showed up at a recycling center. Today, as soon as an officer enters a keyword such as “metal” or “iron” into the search index, all the related incidents would be linked in a one-page report, making the pattern readily apparent.

The system makes getting data practically instantaneous and delivers information in appropriate ways for each audience, generating real-time search results for police officers in the field and delivering KPIs for supervisors at headquarters. Patrol officers access the system via a browser-based application on the Mobile Data Computer (MDC) in their vehicles. For example, if an officer stops a speeding car and performs a quick license plate search, the system could display a police report from earlier in the day in a neighboring city involving a hit-and-run incident, even if the witness at the scene only got part of the license plate number. A suspect in two crimes could be apprehended through a small piece of shared data.

Dispatchers and supervisors can view a different slice of crime data through dashboards at headquarters that display and drill down into KPIs, including crime activity by city, current crime alerts, and a summary of arrests and incidents sorted by categories (such as arson, assault, burglary and criminal mischief). The new crime portal gives supervisors much more power to prevent or quickly solve crimes by efficiently deploying the police force based on patterns that become apparent when records are accessible and grouped in meaningful ways.

Proactive, Predictive, Intelligence-Led Law Enforcement

The Richmond, Houston and Erlanger Police Departments faced a situation common to many police departments: data from different systems—and sometimes other law enforcement agencies—not talking to one another and being difficult and time-consuming—if not impossible—to access. All three departments built customized solutions using off-the-shelf components in a short time to put accurate, timely, targeted information in the hands of decision-makers—from the police chief to dispatchers to officers in the field. Most importantly, by making their processes more efficient and effective with intelligence-led policing, all three saw immediate and continuing results that help them make their communities better places to live. ¦ Kevin Mergruen is Information Builders’ vice president of corporate sales for business intelligence products.

Published in Public Safety IT, Jul/Aug 2010

Oracle Brings Enhancements to Business Intelligence

Responding to the trend that businesses now ask less sophisticated users to perform analysis and rely on software to help them, Oracle recently announced a new release of its flagship Oracle BI Foundational Suite (OBIFS 11.1.1.7) as well as updates to Endeca, the discovery platform that Oracle bought in 2011. Endeca is part of a new class of tools that bring new capabilities in information discovery, self-service access and interactivity. Such approaches represent an important part of the evolution of business intelligence to business analytics as I have noted in my agenda for 2013.
Oracle Business Intelligence Foundational Suite includes many components not limited to Oracle Business Intelligence Enterprise Edition (OBIEE), Oracle Essbase and a scorecard and strategy application. OBIEE is the enabling foundation that federates queries across data sources and enables reporting across multiple platforms. Oracle Essbase is an in-memory OLAP tool that enables forecasting and planning, including what-if scenarios embedded in a range of Oracle BI Applications, which are sold separately. The suite, along with the Endeca software, is integrated with Exalytics, Oracle’s appliance for BI and analytics. Oracle’s appliance strategy, which I wrote about after Oracle World last year invests heavily in the Sun Microsystems hardware acquired in 2010.
These updates are far-ranging and numerous (including more than 200 changes to the software). I’d like to point out some important pieces that advance Oracle’s position in the BI market. A visualization recommendations engine offers guidance on the type of visualization that may be appropriate for a user’s particular data. This feature, already sold by others in the market, may be considered a subset of the broader capability of guided analysis. Advanced visualization techniques have become more important for companies as they make it easier for users to understand data and is critical to compete with the likes of  Tableau, a player in this space which I wrote about last year.
big_data_capabilitiesAnother user-focused update related to visualization is performance tiles, which enable important KPIs to be displayed prominently within the context of the screen surface area. Performance tiles are a great way to start improving the static dashboards that my colleague Mark Smith has critiqued. From what I have seen it is unclear to what degree the business user can define and change Oracle’s performance tile KPIs (for example, the red-flagged metrics assigned to the particular business user that appear within the scorecard function of the software) and how much the system can provide in a prescriptive analytic fashion. Other visualizations that have been added include waterfall charts, which enable dependency analysis; these are especially helpful for pricing analysis by showing users how changes in one dimension impact pricing on the whole. Another is MapViews for manipulation and design to support location analytics that our next generation BI research finds the capability to deploy geographic maps are most important to BI in 47 percent of organizations, and then visualize metrics associated with locations in 41 percent of organizations. Stack charts now provide auto-weighting for 100-percent sum analysis that can be helpful for analytics such as attribution models. Breadcrumbs empower users to understand and drill back through their navigation process, which helps them understand how a person came to a particular analytical conclusion. Finally Trellis View actions provides contextual functionality to help turn data into action in an operational environment. The advancements of these visualizations are critical for Oracle big data efforts as visualization is a top three big data capability not available in 37 percent of organizations according to our big data research and our latest technology innovation research on business analytics found presenting data visually as the second most important capability for organizations according to 48 percent of organizations.
collaborativeThe update to Oracle Smart View for Office also puts more capability in the hands of users. It natively integrates Excel and other Microsoft Office applications with operational BI dashboards so users can perform analysis and prepare ad-hoc reports directly within these desktop environments. This is an important advance for Oracle since our benchmark research in the use of spreadsheets across the enterprise found that the combination of BI and spreadsheets happens all the time or frequently in 74 percent of organization. Additionally the importance of collaborating with business intelligence is essential and having tighter integration is a critical use case as found in our next generation business intelligence research that found using Microsoft Office for collaboration with business intelligence is important to 36 percent of organizations.
Oracle efforts to evolve its social collaboration efforts through what they call Oracle Social Network have advanced significantly but do not appear to be in the short term plan to integrate and make available through its business intelligence offering. Our research finds more than two-thirds (67%) rank this as important and then embedding it within BI is a top need in 38 percent of organizations. Much of what Oracle already provides could be easily integrated and meet business demand for a range of people-based interactions that most are still struggling to manage through e-mail.
Oracle has extended its existing capabilities in its OBIEE with Hadoop integration via a HIVE connector that allows Oracle to pull data into OBIEE from big data sources, while an MDX search function enabled by integration with the Endeca discovery tool allows OBIEE to do full text search and data discovery. Connections to new data sources are critically important in today’s environment; our research shows that retaining and analyzing more data is the number-one ranked use for big data in 29 percent of organizations according to our technology innovation research. Federated data discovery is particularly important as most companies are often unaware of their information assets and therefore unknowingly limit their analysis.
Beyond the core BI product, Oracle made significant advances with Endeca 3.0. Users can now analyze Excel files. This is an existing capability for other vendors, so it was important for Oracle to gain parity here. Beyond that, Endeca now comes with a native JavaScript Object Notation (JSON) reader and support for authorization standards. This furthers its ability to do contextual analysis and sentiment analysis on data in text and social media. Endeca also now can pull data from the Oracle BI server to marry with the analysis. Overall the new version of Endeca enables new business-driven information discovery that is essential to relieve the stress on analysts and IT to create and publish information and insights to business.
Oracle’s continued investments into BI applications that supply prebuilt analytics and these packaged analytics applications span from the front office (sales and marketing), to operations (procurement and supply chain) to the back office (finance and HR). Given the enterprise-wide support, Oracle’s BI can perform cross-functional analytics and deliver fast time to value since users do not have to spend time building the dashboards. Through interoperation with the company’s enterprise applications, customers can execute action directly into applications such as PeopleSoft, JD Edwards or Oracle Business Suite. Oracle has begun to leverage more of its score-carding function that enables KPI relationships to be mapped and information aggregated and trended. Scorecards are important for analytic cultures because they are a common communication platform for executive decision-makers and allow ownership assignment of metrics.
I was surprised to not find much advancement in Oracle business intelligence efforts that operate on smartphones and tablets. Our research finds mobile business intelligence is important to 69 percent of organizations and that 78 percent of organizations reveal that no or some BI capabilities are available in their current deployment of BI. For those that are using mobile business intelligence, only 28 percent are satisfied. For years, IT has not placed a priority on mobile support of BI while business has been clamoring for it and now more readily leading the efforts with 52 percent planning new or expanded deployments on tablets and 32 percent on smartphones. In this highly competitive market to capture more opportunity, Oracle will need to significantly advance its efforts and make its capabilities freely available without passwords as other BI providers have already done. It also will need to recognize that business is more interested in alerts and events through notifications to mobile technology than trying to make the entire suite of BI capabilities replicated on these technologies.
bi_technologyOracle has foundational positions in enterprise applications and database technology and has used these positions to drive significant success in BI. The company’s proprietary “walled garden” approach worked well for years, but now technology changes, including movements toward open source and cloud computing, threaten that entrenched position. Surprisingly, the company has moved slowly off of its traditional messaging stance targeted at the CIO, IT and the data center. That position seems to focus the company too much on the technology-driven 3 V’s of big data and analytics, and not enough on the business driven 3 W’s that I advocate. As the industry moves into the age of analytics, where information is looked upon as a critical commodity and usability is the key to adoption (our research finds usability to be the top evaluation consideration in 63 percent of organizations), CIOs will need to further move beyond its IT approach for BI as I have noted and get more engaged into the requirements of business. Oracle’s business intelligence strategy and how it addresses these business outcomes and the use across all business users is key to the company’s future and organizations should examine these critical advancements to its BI offering very closely to determine if you can improve the value of information and big data in an organization.

Original article

Healthcare, Risk Aversion, and Big Data Case Studies

big data healthcare
Think for a minute about how much we spend on healthcare. In the United States, the numbers break down as follows:
  • Roughly $3 trillion spent annually, a number rising at 6-7% per year
  • This represents about 17% of US Gross Domestic Product (GDP)
  • Some estimates put the number wasted annually on healthcare at a mind-boggling $2 trillion
  • There’s at least $60B in annual Medicare fraud alone each year (and some estimates put that number at $250B) in fraud
For more astonishing data on healthcare, click here. The stats are frightening. With so much waste and opportunity, it should be no surprise that quite a few software vendors are focusing on Big Data–and not just behemoths like IBM. Start-ups like Explorys, Humedica, Apixio, and scores of others have entered the space.

Where’s the Data?

With so much action surrounding Big Data and healthcare, you’d think that there would be a tremendous number of examples. You’d expect there to be more statistics on how Big Data has helped organizations save lives, reduce costs, and increase revenue.
And you’d be wrong.
I’ve worked in hospitals a great deal over my career, and the term risk aversion is entirely apropos. Forget for a minute the significant difficulty in isolating cause and effect. (It’s not easy to accurately claim that deploying Hadoop throughout the organization saved 187 lives in 2012.)
Say for a minute that you’re the CIO of a healthcare organization and you make such a claim. Think about the potential ramifications from lawsuit-happy attorneys. Imagine having to respond to inquiries from lawyers about why you waited so long to deploy software that would have saved so many lives. What were you waiting for? How much will you pay my clients to drop their suit?
This isn’t to say that you can’t find data on, well, Big Data and healthcare. You can. You just have to look really hard–and you’ll more than likely be less than satisfied with the results. For example, this Humedica case study shows increased diagnosis of patients with diabetes who fell between the cracks.
Large organizations are conservative by their nature. Toss in potential lawsuits and it’s easy to understand the paucity results-oriented Big Data healthcare studies. What’s more, we’re still in the early innnings. Expect more data on Big Data in healthcare over the coming years.

Original article