Data warehouse and analytics professionals under increased pressure to develop new data sets faster, according to a survey.
Data automation outfit WhereScape has released a report in partnership with TDWI, revealing how organisations can accelerate data warehouse development to meet the demand for new data sets and insights.
The TDWI ‘Accelerating Data Warehouse Development’ Pulse Report said 70 percent of respondents agree agility is needed, in the sense of speed, productivity, flexibility, and innovation.
The vast majority of survey respondents consider DW acceleration important. In fact, almost two-thirds find it extremely important. More than 64 percent of Data warehouse professionals want their data quality issues automatically recognised and remediated and half want automation for data validation and verification.
The report said that just under 20 percent of DW developers are looking forward to tools supporting intelligent assistants that guide developers, possibly based on artificial intelligence and machine learning. A third believe that automation tools are affordable, compared to hiring and consultants.
In developing a “best practice” approach to accelerated data warehouse development, organisations should, “realise that DW development must keep up with an accelerating and evolving world.” However, data warehouses should continue to support existing business goals, and while supporting mature goals around business reporting and dashboards, modern data warehouse development should also focus on advanced analytics, big data, and real-time operations.
In addition, accelerating data warehouse deployment also depends on employing accelerated DW methods and automated DW tools, the modernisation of development methods and a clear focus on automation to cover broader data disciplines, enabled by software that supports automation and agility.
WhereScape EMEA VP & GM Rob Mellor said: “Data warehouse professionals must develop more data solutions than ever, faster than ever. As a result, it’s vital that they are given the tools, resources and guidance to develop these best practices so they can balance the need for effective delivery against the growing pressure to accelerate development. Organisations that achieve these goals will be better placed to deliver the insight they need to make more effective decisions, maximise efficiency and boost competitive advantage.”
