EMC warns of the perils of masses of small data

zxzzzzd1Guy Churchward, head of EMC’s $20-billion core technologies division, has warned that small data is going to cause even bigger headaches than the big stuff.

Taking to the Economic Times  Churchward said that data challenges for the Internet of Things or driverless cars were huge,

He said that millions of driverless cars, and billions of other internetconnected devices will not be Big Data. “What you have is not big data, it is actually `small data’ – because what it is, is billions and billions of small data objects.”

EMC expects IoT to create a sprawl of billions of autonomous devices, which will create security, storage and management nightmares in future.

Churchward warned that  “small data sprawl” will take the challenges of Big Data and make them 100x more difficult.

Security, storage, management and applications would be completely different in a world filled with billions of devices, each of which will have its own big data. None of the currently available tools and applications would work in such environments.

Part of EMC’s over $2.3-billion research and development budget is being used to address this `small data’ problem but the company thinks that it will take between three to five years to start bearing fruit.