Welcome!

FinTech Journal Authors: Kevin Jackson, Xenia von Wedel, Ed Featherston, Liz McMillan, Yeshim Deniz

Related Topics: FinTech Journal, Agile Computing, @CloudExpo, @DXWorldExpo

FinTech Journal: Article

Disrupting Application Architecture | @CloudExpo #SaaS #PaaS #Cloud #AI #ML

We will see more and more solutions heading towards serverless architecture

A revolutionary change in the industry was the foundation for cloud on the automation of virtualization technologies. Initially it was meant for infrastructure, but with the advent of new and innovative cloud services it has crossed the boundary of Infrastructure and invaded the application space. The concept of ‘as a Service' model has three pillars: IaaS (Infrastructure as a Service), PaaS (Platform as a Service) and SaaS (Software as a Service). Over a period of time cloud services have grown and diversified to the extent that clubbing the services into these three pillars is not only difficult but unattainable. That's the reason none of the public cloud providers classify their services in ‘as a Service' model category.

A public cloud provider has an edge over a private cloud and differentiates itself by providing rich services as compared to focus on automation of infrastructure components by latter. Organization using private cloud will not benefit even though when they imitate the Public cloud for rich services (e.g. API Gateway, S3, SQS, App Stream, Notification Services, etc.)  as they will face couple of challenges. Firstly, they will not be able to achieve economies of scale resulting in higher costs. Secondly there are few services which have set up limitations Cloudfront CDN (Content delivery network) is one of them. It is quite fair to conclude Public cloud provider will lead the baton with innovative services.

SaaS has been used for a while and is not new to the industry; however, it has limitations due to its restraints in terms of inability to scale with dynamic demand. SaaS was complemented with Cloud due to high availability, scalability and reliability to make it more robust and dynamic for the changing needs. Cloud has completely changed the way we consume infrastructure. Soon it is going to disrupt the way we build an application. It will be interesting to know how and why our way of designing application will get disrupted because of Cloud with below business scenario.

Business Scenario
A larges online retailer galaxyportal.com (fictitious name) received 3 million hits per day and has more than million products to offer to the customer. They have started seeing a decline in customer satisfaction. One of the main reason was the response time during the flash sale. The company was able to secure exclusive right of demanding product but unable to monetize the benefit due to technical glitches (website crash, slow response time, recovery time was more than an hour). The marketing department is unable to roll-out the right offering for buyers because the current system doesn't give much insight of user behavior. Recent consumer survey reveals that mobile adoption is pretty high and the customer are preferring more online shopping. As per a recent survey by the marketing department, overall online business will grow 10 times in next 5 years.

Company CIO decided to revamp the architecture and build a completely new solution which will address current challenges and make them ready for future opportunities.

Based on the customer survey feedback, the customer expects a notification on his/her mobile as soon their order gets dispatched. The customer would also like to hear more if the offering is relevant to them. To provide rich user experience business wants to add:

  • High Performance System with Express Checkout should be carried out within 1 sec
  • Currently, order confirmation time is more than 2 hours due to large number of batch processing. The new system should bring down to less than 5 minutes
  • Along with product catalogue, short multi-resolution and multi-format video and images must be added for better visualization and description
  • The user should be able to do offline check-out, It will provide flexibility and save time
  • Marketing team will require detail insight of user behavior in real time
  • As per recent regulation organization needs to keep the data for 10 years. In context to the same tool should provide cost effective solution for archiving 100 terabytes of data.

The company has some budgetary constraints along with the insufficient IT team size leading to the decision for outsourcing the tool development. Glaxyportal is now looking for high efficiency solution which will fulfill its above requirement.

Solution:

Figure 1. Conceptual Architecture

Above diagram is for indicative purpose only to outline the high-level architecture for eCommerce galaxyport.com. Architect understood the business criticality of the new solution. They identified two major problems; existing software products were best then but now outdated  and secondly current infrastructure isn't scalable to meet future and ad-hoc business demands. Galaxyportal was going through credit crunch, however their new solution has good future prospect. To meet the business demand architect decided to go ahead with the solution combination of SaaS and Cloud services. Serverless (no explicit infrastructure required, as in no servers, no deployments onto servers, no installed software of any kind.) architecture is an ideal approach for low maintenance solution. The architect decided to harness the power of AWS cloud services and proposed below architecture.

Figure 2 : Serverless Architecture in Cloud

Architecture proposed is very different from traditional one. The combination of SaaS with Cloud services makes complete solution as pay-as-you-go model which means Galaxyportal will be running on zero cost in case the services are not being used and hence the solution acts as a perfect fit in the current situation. Galaxyportal architect proposes uses of various AWS cloud services to achieve required results.

  1. Route 53 - will be used for DNS services
  2. ELB (elastic load balancer) - Both mobile app and web portal users will use services through AWS ELB
  3. EC2 Container Service - eCommerce Web and Admin portal will be deployed on it. They are highly scalable and support millions of hit for the web portal. At the same time, it eliminates the need of own cluster management infrastructure. EC2 Container Service also allows development team to seamlessly adopt DevOps
  4. Autoscaling - used to set-up EC2 Container . It's adjustable scalability property will scale container automatically depending upon the workload.
  5. Lambda - Instead of large monolithic business services, microservices architecture approach will be used to deliver business services. It will deliver business services without any provisioning of infrastructure
  6. API Gateway -  will be used to expose Lambda API business services. API Gateway will act as a "front door" for applications to access data, business logic code running on AWS Lambda. Mobile app will also use API Gateway to access business services.
  7. Cloud Search - Search is one of the most important features of eCommerce and AWS Cloud Search fulfills the criterion. It's a cost-effective and scalable solution
  8. Elasticache - For caching of frequently used information AWS Elasticache will be used
  9. SWF - will be used for any workflow related task e.g.; Order processing. SWF will be used along with Oracle Cloud ERP
  10. SNS Service -  All sorts of notification e.g.; Mobile, email will be made through it
  11. Dynamo DB - NoSQL database will be used for high volume transactional data
  12. S3 - All image and product videos will be available through S3.
  13. CDN - SaaS-based ECM product will be used for storing and delivering of static content. AWS CDN network will be used to cache the data at edge location for faster delivery to meet the demand of millions hit
  14. Cognito - The mobile app will have AWS Cognito capability to fulfil the demand of offline shopping through data synchronization
  15. Mobile Analytics - will be used to capture user behavior. It will pass the input to ElasticSearch for further analysis
  16. Kinesis - Real-time analytics is one of the key business requirements stated by Galaxyportal. Salesforce Marketing cloud will also be used to provide insight to a marketing department. AWS kinesis will be used to stream real-time input (e.g., click stream) to ElasticSearch to reveal insight from captured data.
  17. ElasticSearch -  will be used for real-time application monitoring, and click stream analytics to get better insight of user behavior in real time.
  18. Glacier - AWS Glacier is a low-cost archiving solution and will be used for archiving more than 100 terabytes of data
  19. Elastic Transcoder - will be used to convert images/videos into multi-format and multi-resolution.

With the above cost effective and scalable architecture, we can foresee more and more solutions heading towards serverless architecture. With the evolution of Cloud services, the thought process for creating architecture has got revamped and hence resulting in disrupting application architecture. The only drawback of this approach is lock-in with cloud vendor because the application is strongly tied to a cloud provider.

The intent of the above architecture is to explain how an enterprise application can be delivered using a serverless architecture. Above solution is designed using AWS. Azure is also providing similar services. Refer to my earlier blog AWS and Azure focused on Application Services. Azure services work in similar fashion and to get results replace AWS service with comparable Azure services.

More Stories By Amit Kumar

Amit Kumar is Manager Architect at CSC. In his current role, he is leading and mentoring a group of Architects. He acts as a consultant to both project delivery team and clients. His key focus areas are architecture governance and technical consulting. He demarcated structure approach for Architecture definition by breaking into four steps (Strategy, Requirement, Definition and Validation). He also conducts training on Solution Architecture, Application Guidance and Archimate training. He started his career in .NET and has played a role of Application architects for long now. He is passionate about Cloud computing and involved in client data centre migration on CSC cloud. He is an AWS Certified Solution Architect - Professional and a TOGAF Certified practitioner.

@ThingsExpo Stories
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
BnkToTheFuture.com is the largest online investment platform for investing in FinTech, Bitcoin and Blockchain companies. We believe the future of finance looks very different from the past and we aim to invest and provide trading opportunities for qualifying investors that want to build a portfolio in the sector in compliance with international financial regulations.
Imagine if you will, a retail floor so densely packed with sensors that they can pick up the movements of insects scurrying across a store aisle. Or a component of a piece of factory equipment so well-instrumented that its digital twin provides resolution down to the micrometer.
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settle...
Product connectivity goes hand and hand these days with increased use of personal data. New IoT devices are becoming more personalized than ever before. In his session at 22nd Cloud Expo | DXWorld Expo, Nicolas Fierro, CEO of MIMIR Blockchain Solutions, will discuss how in order to protect your data and privacy, IoT applications need to embrace Blockchain technology for a new level of product security never before seen - or needed.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, discussed some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he covered some of the best practices for structured team migration an...
No hype cycles or predictions of a gazillion things here. IoT is here. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, an Associate Partner of Analytics, IoT & Cybersecurity at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He also discussed the evaluation of communication standards and IoT messaging protocols, data...
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, provided a fun and simple way to introduce Machine Leaning to anyone and everyone. He solved a machine learning problem and demonstrated an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intelligence and B...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
We are given a desktop platform with Java 8 or Java 9 installed and seek to find a way to deploy high-performance Java applications that use Java 3D and/or Jogl without having to run an installer. We are subject to the constraint that the applications be signed and deployed so that they can be run in a trusted environment (i.e., outside of the sandbox). Further, we seek to do this in a way that does not depend on bundling a JRE with our applications, as this makes downloads and installations rat...
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
DX World EXPO, LLC, a Lighthouse Point, Florida-based startup trade show producer and the creator of "DXWorldEXPO® - Digital Transformation Conference & Expo" has announced its executive management team. The team is headed by Levent Selamoglu, who has been named CEO. "Now is the time for a truly global DX event, to bring together the leading minds from the technology world in a conversation about Digital Transformation," he said in making the announcement.
In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lead...
Digital Transformation (DX) is not a "one-size-fits all" strategy. Each organization needs to develop its own unique, long-term DX plan. It must do so by realizing that we now live in a data-driven age, and that technologies such as Cloud Computing, Big Data, the IoT, Cognitive Computing, and Blockchain are only tools. In her general session at 21st Cloud Expo, Rebecca Wanta explained how the strategy must focus on DX and include a commitment from top management to create great IT jobs, monitor ...
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
The IoT Will Grow: In what might be the most obvious prediction of the decade, the IoT will continue to expand next year, with more and more devices coming online every single day. What isn’t so obvious about this prediction: where that growth will occur. The retail, healthcare, and industrial/supply chain industries will likely see the greatest growth. Forrester Research has predicted the IoT will become “the backbone” of customer value as it continues to grow. It is no surprise that retail is ...