Welcome!

FinTech Journal Authors: John Katrick, Liz McMillan, Roger Strukhoff, Pat Romanski, Kevin Jackson

Related Topics: FinTech Journal, Agile Computing, @CloudExpo, @DXWorldExpo

FinTech Journal: Article

Disrupting Application Architecture | @CloudExpo #SaaS #PaaS #Cloud #AI #ML

We will see more and more solutions heading towards serverless architecture

A revolutionary change in the industry was the foundation for cloud on the automation of virtualization technologies. Initially it was meant for infrastructure, but with the advent of new and innovative cloud services it has crossed the boundary of Infrastructure and invaded the application space. The concept of ‘as a Service' model has three pillars: IaaS (Infrastructure as a Service), PaaS (Platform as a Service) and SaaS (Software as a Service). Over a period of time cloud services have grown and diversified to the extent that clubbing the services into these three pillars is not only difficult but unattainable. That's the reason none of the public cloud providers classify their services in ‘as a Service' model category.

A public cloud provider has an edge over a private cloud and differentiates itself by providing rich services as compared to focus on automation of infrastructure components by latter. Organization using private cloud will not benefit even though when they imitate the Public cloud for rich services (e.g. API Gateway, S3, SQS, App Stream, Notification Services, etc.)  as they will face couple of challenges. Firstly, they will not be able to achieve economies of scale resulting in higher costs. Secondly there are few services which have set up limitations Cloudfront CDN (Content delivery network) is one of them. It is quite fair to conclude Public cloud provider will lead the baton with innovative services.

SaaS has been used for a while and is not new to the industry; however, it has limitations due to its restraints in terms of inability to scale with dynamic demand. SaaS was complemented with Cloud due to high availability, scalability and reliability to make it more robust and dynamic for the changing needs. Cloud has completely changed the way we consume infrastructure. Soon it is going to disrupt the way we build an application. It will be interesting to know how and why our way of designing application will get disrupted because of Cloud with below business scenario.

Business Scenario
A larges online retailer galaxyportal.com (fictitious name) received 3 million hits per day and has more than million products to offer to the customer. They have started seeing a decline in customer satisfaction. One of the main reason was the response time during the flash sale. The company was able to secure exclusive right of demanding product but unable to monetize the benefit due to technical glitches (website crash, slow response time, recovery time was more than an hour). The marketing department is unable to roll-out the right offering for buyers because the current system doesn't give much insight of user behavior. Recent consumer survey reveals that mobile adoption is pretty high and the customer are preferring more online shopping. As per a recent survey by the marketing department, overall online business will grow 10 times in next 5 years.

Company CIO decided to revamp the architecture and build a completely new solution which will address current challenges and make them ready for future opportunities.

Based on the customer survey feedback, the customer expects a notification on his/her mobile as soon their order gets dispatched. The customer would also like to hear more if the offering is relevant to them. To provide rich user experience business wants to add:

  • High Performance System with Express Checkout should be carried out within 1 sec
  • Currently, order confirmation time is more than 2 hours due to large number of batch processing. The new system should bring down to less than 5 minutes
  • Along with product catalogue, short multi-resolution and multi-format video and images must be added for better visualization and description
  • The user should be able to do offline check-out, It will provide flexibility and save time
  • Marketing team will require detail insight of user behavior in real time
  • As per recent regulation organization needs to keep the data for 10 years. In context to the same tool should provide cost effective solution for archiving 100 terabytes of data.

The company has some budgetary constraints along with the insufficient IT team size leading to the decision for outsourcing the tool development. Glaxyportal is now looking for high efficiency solution which will fulfill its above requirement.

Solution:

Figure 1. Conceptual Architecture

Above diagram is for indicative purpose only to outline the high-level architecture for eCommerce galaxyport.com. Architect understood the business criticality of the new solution. They identified two major problems; existing software products were best then but now outdated  and secondly current infrastructure isn't scalable to meet future and ad-hoc business demands. Galaxyportal was going through credit crunch, however their new solution has good future prospect. To meet the business demand architect decided to go ahead with the solution combination of SaaS and Cloud services. Serverless (no explicit infrastructure required, as in no servers, no deployments onto servers, no installed software of any kind.) architecture is an ideal approach for low maintenance solution. The architect decided to harness the power of AWS cloud services and proposed below architecture.

Figure 2 : Serverless Architecture in Cloud

Architecture proposed is very different from traditional one. The combination of SaaS with Cloud services makes complete solution as pay-as-you-go model which means Galaxyportal will be running on zero cost in case the services are not being used and hence the solution acts as a perfect fit in the current situation. Galaxyportal architect proposes uses of various AWS cloud services to achieve required results.

  1. Route 53 - will be used for DNS services
  2. ELB (elastic load balancer) - Both mobile app and web portal users will use services through AWS ELB
  3. EC2 Container Service - eCommerce Web and Admin portal will be deployed on it. They are highly scalable and support millions of hit for the web portal. At the same time, it eliminates the need of own cluster management infrastructure. EC2 Container Service also allows development team to seamlessly adopt DevOps
  4. Autoscaling - used to set-up EC2 Container . It's adjustable scalability property will scale container automatically depending upon the workload.
  5. Lambda - Instead of large monolithic business services, microservices architecture approach will be used to deliver business services. It will deliver business services without any provisioning of infrastructure
  6. API Gateway -  will be used to expose Lambda API business services. API Gateway will act as a "front door" for applications to access data, business logic code running on AWS Lambda. Mobile app will also use API Gateway to access business services.
  7. Cloud Search - Search is one of the most important features of eCommerce and AWS Cloud Search fulfills the criterion. It's a cost-effective and scalable solution
  8. Elasticache - For caching of frequently used information AWS Elasticache will be used
  9. SWF - will be used for any workflow related task e.g.; Order processing. SWF will be used along with Oracle Cloud ERP
  10. SNS Service -  All sorts of notification e.g.; Mobile, email will be made through it
  11. Dynamo DB - NoSQL database will be used for high volume transactional data
  12. S3 - All image and product videos will be available through S3.
  13. CDN - SaaS-based ECM product will be used for storing and delivering of static content. AWS CDN network will be used to cache the data at edge location for faster delivery to meet the demand of millions hit
  14. Cognito - The mobile app will have AWS Cognito capability to fulfil the demand of offline shopping through data synchronization
  15. Mobile Analytics - will be used to capture user behavior. It will pass the input to ElasticSearch for further analysis
  16. Kinesis - Real-time analytics is one of the key business requirements stated by Galaxyportal. Salesforce Marketing cloud will also be used to provide insight to a marketing department. AWS kinesis will be used to stream real-time input (e.g., click stream) to ElasticSearch to reveal insight from captured data.
  17. ElasticSearch -  will be used for real-time application monitoring, and click stream analytics to get better insight of user behavior in real time.
  18. Glacier - AWS Glacier is a low-cost archiving solution and will be used for archiving more than 100 terabytes of data
  19. Elastic Transcoder - will be used to convert images/videos into multi-format and multi-resolution.

With the above cost effective and scalable architecture, we can foresee more and more solutions heading towards serverless architecture. With the evolution of Cloud services, the thought process for creating architecture has got revamped and hence resulting in disrupting application architecture. The only drawback of this approach is lock-in with cloud vendor because the application is strongly tied to a cloud provider.

The intent of the above architecture is to explain how an enterprise application can be delivered using a serverless architecture. Above solution is designed using AWS. Azure is also providing similar services. Refer to my earlier blog AWS and Azure focused on Application Services. Azure services work in similar fashion and to get results replace AWS service with comparable Azure services.

More Stories By Amit Kumar

Amit Kumar is Manager Architect at CSC. In his current role, he is leading and mentoring a group of Architects. He acts as a consultant to both project delivery team and clients. His key focus areas are architecture governance and technical consulting. He demarcated structure approach for Architecture definition by breaking into four steps (Strategy, Requirement, Definition and Validation). He also conducts training on Solution Architecture, Application Guidance and Archimate training. He started his career in .NET and has played a role of Application architects for long now. He is passionate about Cloud computing and involved in client data centre migration on CSC cloud. He is an AWS Certified Solution Architect - Professional and a TOGAF Certified practitioner.

@ThingsExpo Stories
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, examined the regulations and provided insight on how it affects technology, challenges the established rules and will usher in new levels of diligence arou...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone inn...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, provided a fun and simple way to introduce Machine Leaning to anyone and everyone. He solved a machine learning problem and demonstrated an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intelligence and B...
"Digital transformation - what we knew about it in the past has been redefined. Automation is going to play such a huge role in that because the culture, the technology, and the business operations are being shifted now," stated Brian Boeggeman, VP of Alliances & Partnerships at Ayehu, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Evatronix provides design services to companies that need to integrate the IoT technology in their products but they don't necessarily have the expertise, knowledge and design team to do so," explained Adam Morawiec, VP of Business Development at Evatronix, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
The 22nd International Cloud Expo | 1st DXWorld Expo has announced that its Call for Papers is open. Cloud Expo | DXWorld Expo, to be held June 5-7, 2018, at the Javits Center in New York, NY, brings together Cloud Computing, Digital Transformation, Big Data, Internet of Things, DevOps, Machine Learning and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding busin...
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, led attendees through the exciting evolution of the cloud. He looked at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering m...
Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, discussed some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he covered some of the best practices for structured team migration an...
No hype cycles or predictions of a gazillion things here. IoT is here. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, an Associate Partner of Analytics, IoT & Cybersecurity at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He also discussed the evaluation of communication standards and IoT messaging protocols, data...
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, discussed how they built...
22nd International Cloud Expo, taking place June 5-7, 2018, at the Javits Center in New York City, NY, and co-located with the 1st DXWorld Expo will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud ...
22nd International Cloud Expo, taking place June 5-7, 2018, at the Javits Center in New York City, NY, and co-located with the 1st DXWorld Expo will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud ...
DevOps at Cloud Expo – being held June 5-7, 2018, at the Javits Center in New York, NY – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Among the proven benefits,...
@DevOpsSummit at Cloud Expo, taking place June 5-7, 2018, at the Javits Center in New York City, NY, is co-located with 22nd Cloud Expo | 1st DXWorld Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait...
SYS-CON Events announced today that T-Mobile exhibited at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on qua...