Welcome!

FinTech Journal Authors: Yeshim Deniz, Zakia Bouachraoui, Elizabeth White, Pat Romanski, Liz McMillan

Related Topics: FinTech Journal, Containers Expo Blog, @DXWorldExpo, @DevOpsSummit

FinTech Journal: Article

Agile Analytics | @DevOpsSummit #DevOps #BigData #ContinuousDelivery

DevOps + Continuous Delivery + Big Data = Continuous Analytics

Five Key Requirements for Enabling Agile Analytics
By Yann Guernion

In today's digital economy, companies are faced with a fast data challenge as well as a Big Data one. As a result they are under pressure to adapt their analytics processes and data flows at pace to move beyond traditional data warehouse silos.

Big Data projects are either too big or too complex to handle the traditional way. That's why most projects by companies at the start of their Big Data initiative have no process at all. Waterfall approaches are notably inefficient as you probably won't have access to proper staging environment and only limited time and scale for qualification.

Big Data and DevOps
Big Data implicitly promotes DevOps because there is no ability to separate Operations from Development when you ultimately discover the relevance of your algorithms at the production stage. It is inevitable that Big Data will either promote a DevOps initiative or feed in to your current DevOps model if a transformation has already occurred in your IT department.

Continuous Analytics is an extension of DevOps and Continuous Delivery when applied to Big Data. It provides ways to incorporate analytics into the agile model where building, testing, provisioning and deploying are all run as automated processes.

Of course putting this to work requires you to address some specific organizational and automation challenges:

  1. Data Scientists and Data Analysts that usually work in isolation from the Big Data Engineers and Architects need to be onboarded to impose higher levels of process standardization and make handoffs easier.
  2. The complexity of underlying Big Data technology must be hidden from Data Scientists by exposing clean high-level APIs to them, and predefined components that can be used in simple graphical user interfaces.
  3. Data Scientists have to store their code, workflows and associated artifacts to the same repository that developers and other Big Data team members are using, so the application objects can be easily pulled out and orchestrated during the deployment process.
  4. Big Data infrastructure has to be abstracted so that it can be pushed out in the manner of a continuous release and deployed to any type of environment, whether is it private, public or hybrid cloud. The ideal state would look like a ‘Hadoop-as-a-Service' consumption model.
  5. Release coordination needs to be combined with deployment automation across the delivery pipeline, whether open-source or commercial tools are used.

Access to the right information at the right time is essential to make informed business decisions, get ahead of the competition and drive innovation. Heavy processes simply do not fit into our fast-changing environment, which is why Continuous Analytics leverages what has been learned from Agile and DevOps and applies these methodologies to Big Data development.

In five years enterprises will be dealing with even larger volumes of structured and unstructured data and using it to make even smarter decisions. To be successful, they need to allow Data Scientists and Big Data developers to get to the data and analytics as quickly as possible. So now is a good time to consider looking into Continuous Analytics, as more than ever, speed is of the essence.

Read the original blog entry...

More Stories By Automic Blog

Automic, a leader in business automation, helps enterprises drive competitive advantage by automating their IT factory - from on-premise to the Cloud, Big Data and the Internet of Things.

With offices across North America, Europe and Asia-Pacific, Automic powers over 2,600 customers including Bosch, PSA, BT, Carphone Warehouse, Deutsche Post, Societe Generale, TUI and Swisscom. The company is privately held by EQT. More information can be found at www.automic.com.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


IoT & Smart Cities Stories
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
Disruption, Innovation, Artificial Intelligence and Machine Learning, Leadership and Management hear these words all day every day... lofty goals but how do we make it real? Add to that, that simply put, people don't like change. But what if we could implement and utilize these enterprise tools in a fast and "Non-Disruptive" way, enabling us to glean insights about our business, identify and reduce exposure, risk and liability, and secure business continuity?
DXWorldEXPO LLC announced today that Telecom Reseller has been named "Media Sponsor" of CloudEXPO | DXWorldEXPO 2018 New York, which will take place on November 11-13, 2018 in New York City, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
To Really Work for Enterprises, MultiCloud Adoption Requires Far Better and Inclusive Cloud Monitoring and Cost Management … But How? Overwhelmingly, even as enterprises have adopted cloud computing and are expanding to multi-cloud computing, IT leaders remain concerned about how to monitor, manage and control costs across hybrid and multi-cloud deployments. It’s clear that traditional IT monitoring and management approaches, designed after all for on-premises data centers, are falling short in ...
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and G...
Discussions of cloud computing have evolved in recent years from a focus on specific types of cloud, to a world of hybrid cloud, and to a world dominated by the APIs that make today's multi-cloud environments and hybrid clouds possible. In this Power Panel at 17th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists addressed the importance of customers being able to use the specific technologies they need, through environments and ecosystems that expose their APIs to make true ...
The current age of digital transformation means that IT organizations must adapt their toolset to cover all digital experiences, beyond just the end users’. Today’s businesses can no longer focus solely on the digital interactions they manage with employees or customers; they must now contend with non-traditional factors. Whether it's the power of brand to make or break a company, the need to monitor across all locations 24/7, or the ability to proactively resolve issues, companies must adapt to...