The Four Vs of Data: Volume, Variety, Velocity, Veracity
Bill Jenkins | February 28, 2017
Traditional policy administration systems have been architected and designed to handle large volumes of operational data, in specified formats and to aggregate data to save storage space. Large volumes of non-operational data have traditionally not been captured and processed for various reasons, mostly because the costs to do so was viewed as far greater than the value of the insights the company could derive from the use of this data.
As data has now come to be viewed as a means of competing in the insurance industry, carriers have focused on how data—all types of data—can be used to provide them a competitive advantage. Even though policy administrative systems and other insurance processing systems have enhanced their technical capabilities to become more agile, flexible, and robust, these systems continue to be hampered in their abilities to handle the characteristics of big data:
- Volume: the amount of data being created and available is significant compared to previous times
- Variety: data now comes from multiple sources in multiple formats and from multiple devices
- Velocity: data is being streamed extremely fast, 24 by 7
- Veracity: these multiple sources of data and volume and speed of this data poses quality challenges.
Few if any insurance processing systems can accommodate these characteristics as most systems have constraints in their ability to handle unstructured data, and to process and store large volumes of data at high speeds. These systems possess relational data bases and generally batch oriented in processing.
Systems based on older technology often include batch oriented processing. Newer systems tend to be built upon relational databases, which allow for new tables to be added easily and also include the ability to integrate with outside data sources. This provides a means for big data to be managed (interpreted, cleansed, analyzed, aggregated) and then matched and linked to policy administration databases.
To address the demand to use big data in order to gain better insight into company operations and enhance their predictive analytics capabilities, companies have begun to leverage the new software and infrastructure technologies being offered in the cloud. Use of cloud solutions like Hadoop for distributed storage and parallel processing of large data sets to store and process unstructured/big data at high speeds are now being leveraged by carriers, thereby making it easier for them to analyze and obtain value from this data.
Many organizations are looking to these cloud solutions to augment their core systems with pre-built storage, analytic solutions that also enable the company to have the scalability needed for big data. The availability of cloud processing does open up the ability to store and process “unlimited” amounts of data but it comes with its own set of concerns such as security, privacy, and what resources the company might need to manage these cloud solutions. Furthermore, processes need to be built to connect, integrate, interpret and use this information.
Technology is, however, not the only consideration a company must address. A company needs to take a holistic view and approach as it undertakes a big data initiative if it is to be successful. The components of people, process, technology, and data need to be addressed as these fit into the overall data initiative. This also means incorporating the developed information into the business routine and aligning its use to the business strategy so it adds value to the organization.
- Enterprise Architecture in an Agile World
- Top 10 Tips for Securing Your Mobile Devices and Sensitive Client Data
- Industry Insight: 4 Global Insurance Trends in Digital, Data, Content Services and Security
- Diving Deeper into Prioritizing Your Strategic Digital investments
- Why Content Rules
- How Mass Personalization Will Open the Small Business Benefits Market
- At Year End 2017, Will Your Organization Be Protected from Cyber Risks?
- Do Insurance Bots Dream of Mitigating Risk?
- Conditioned to Respond
- Managing & Mobilizing Insurance Data in a Connected World
- Race to the Finish Line
- New Tools, New Opportunities in Claims
- ITA LIVE: Reaching Insurance Industry Crossroads
- Advice to Insurance IT Leaders: Keep Your Eye on the Ball
- New Date, Venue for ITA LIVE 2017
- Guidewire Makes Major Push to Small and Midtier Market by Acquiring ISCS
- Insurance Disruption is Happening Right Now
- Insurity Adds Strategic Investment Partner, General Atlantic
- Beyond Transformation: The Convergence of Finance, Risk, and Actuarial Functions
- The Rapid Evolution of Consumer Protection Regulation
- Talent Hunt: Finding, Attracting, Retaining Top People
- Insurers Flexing Their Distribution Models
- Technology Driving Disruption in Insurance
- Fear of ‘Next Bubble’ Challenges Life, Annuity Carriers
- Technology Allows Commercial Lines Insurers to Stand Out
- Single Sign-on Viewed as Biggest Tech Challenge for Agencies
- ISCS Observes 20th Anniversary; Scurto Predicts Major Changes Ahead
- Policyholders and Their First Impressions
- Progressive Making Progress on the UBI Front
- High and Dry: Insurers Search for Disaster Recovery Plans
- Insurers Sign The (Un)Dotted Line
- Reflections of a Retired Insurance CIO
- Mobile Device Management Just One Answer to BYOD Issue
- Lessons from GEICO and Progressive on Winning the Critical Buying Stage
- You Are a Target for a Cyber Attack
- Web-based Systems are the Next Evolution in Claims Technology
- Gaining a “Wow” Experience from Web Users
- Time to Shift from Business/IT Alignment to Business/IT Alliance
- Healthcare Insurers Changing to Consumer Model
- Organization is the Key for Selecting Software Vendors
- Analysts Expound on the Needs of the Mid-tier Insurance Market
- Finding the Cure for Obamacare’s Website
- New Software Solutions Benefit Insurers on the Inside and Outside
- Products, Market Impede Investment in Systems for Life Insurers
- Combatting Cyber Threats: Predict, Prevent, Persist
- The Future of Telematics Heads Beyond Insurance
- The Shame in Cyber Security Lapses
- Building Policy Administration Systems for the Future
- Insurers Look Into The Eyes of Their Policyholders
- It’s a New Dawn for the ITA
INSURANCE IT NEWS
- OneWorld Instech Launches OWIT Services Division
- The Institutes RiskBlock Alliance™ Announces EY as Blockchain Security and Risk Services Provider
- Encompass Helps Keep Customers Connected & Safe with Roost Home Safety Devices
- Slice Labs Strengthens Insurance Cloud Focus with Veteran Industry Executive Hire
- Mennonite Mutual Selects Finys for Core System Replacement
- Entertainment Risk Goes Live with ClarionDoor Issuance
- AAIS Collaborates With IBM To Transform Insurance Regulatory Reporting Using Blockchain
- K2 Insurance Services Implements One Inc for Digital Billing Capabilities
The Email Chat is a regular feature of the ITA Pro magazine and website. We send a series of questions to an insurance IT leader in search of thought-provoking responses on important issues facing the insurance industry.
ITA is pleased to present the 2014 Webinar Series. We have many topics for you to choose from and attendance is open to all ITA members. The webinar topics are current and exciting — ranging from predictive analytics to telematics and will focus on the direction insurance carriers need to follow for the future. All webinars are presented by insurance IT professionals along with some of the leading analysts and consultants in the field. There is no cost to attend an ITA webinar. For more information and to register for the webinar, click the “title” of the webinar below.
BLOGS AND COLUMNS
It has become a common refrain over the past few years to view the practice of enterprise architecture (EA) as something that time has passed by, much... READ MORE
One important trend in society over the past decade is our increasing ability to create and consume a seemingly unlimited amount of digital content... READ MORE
You have surely heard it said that small businesses are the growth engine for America. Today, the phrase has a special ring to it for benefits... READ MORE
With stagnant growth and lingering low interest rates, the life insurance industry faces a challenging future... READ MORE
Finding insurance carriers willing to write commercial lines risks has always been a challenge for producers... READ MORE
As Guidewire Software prepares for the start of Connections, its 11th annual user conference that begins on Nov. 2, Brian Desmond, chief marketing... READ MORE
Fraud detection has always been and will continue to be a critical component of claims management. Learning the lessons from current claims Straight... READ MORE
- Vendor Views