Welcome!

FinTech Journal Authors: Liz McMillan, Yeshim Deniz, Elizabeth White, Pat Romanski, Ed Featherston

Related Topics: FinTech Journal, Agile Computing, @CloudExpo, @BigDataExpo

FinTech Journal: Article

Disrupting Application Architecture | @CloudExpo #SaaS #PaaS #Cloud #AI #ML

We will see more and more solutions heading towards serverless architecture

A revolutionary change in the industry was the foundation for cloud on the automation of virtualization technologies. Initially it was meant for infrastructure, but with the advent of new and innovative cloud services it has crossed the boundary of Infrastructure and invaded the application space. The concept of ‘as a Service' model has three pillars: IaaS (Infrastructure as a Service), PaaS (Platform as a Service) and SaaS (Software as a Service). Over a period of time cloud services have grown and diversified to the extent that clubbing the services into these three pillars is not only difficult but unattainable. That's the reason none of the public cloud providers classify their services in ‘as a Service' model category.

A public cloud provider has an edge over a private cloud and differentiates itself by providing rich services as compared to focus on automation of infrastructure components by latter. Organization using private cloud will not benefit even though when they imitate the Public cloud for rich services (e.g. API Gateway, S3, SQS, App Stream, Notification Services, etc.)  as they will face couple of challenges. Firstly, they will not be able to achieve economies of scale resulting in higher costs. Secondly there are few services which have set up limitations Cloudfront CDN (Content delivery network) is one of them. It is quite fair to conclude Public cloud provider will lead the baton with innovative services.

SaaS has been used for a while and is not new to the industry; however, it has limitations due to its restraints in terms of inability to scale with dynamic demand. SaaS was complemented with Cloud due to high availability, scalability and reliability to make it more robust and dynamic for the changing needs. Cloud has completely changed the way we consume infrastructure. Soon it is going to disrupt the way we build an application. It will be interesting to know how and why our way of designing application will get disrupted because of Cloud with below business scenario.

Business Scenario
A larges online retailer galaxyportal.com (fictitious name) received 3 million hits per day and has more than million products to offer to the customer. They have started seeing a decline in customer satisfaction. One of the main reason was the response time during the flash sale. The company was able to secure exclusive right of demanding product but unable to monetize the benefit due to technical glitches (website crash, slow response time, recovery time was more than an hour). The marketing department is unable to roll-out the right offering for buyers because the current system doesn't give much insight of user behavior. Recent consumer survey reveals that mobile adoption is pretty high and the customer are preferring more online shopping. As per a recent survey by the marketing department, overall online business will grow 10 times in next 5 years.

Company CIO decided to revamp the architecture and build a completely new solution which will address current challenges and make them ready for future opportunities.

Based on the customer survey feedback, the customer expects a notification on his/her mobile as soon their order gets dispatched. The customer would also like to hear more if the offering is relevant to them. To provide rich user experience business wants to add:

  • High Performance System with Express Checkout should be carried out within 1 sec
  • Currently, order confirmation time is more than 2 hours due to large number of batch processing. The new system should bring down to less than 5 minutes
  • Along with product catalogue, short multi-resolution and multi-format video and images must be added for better visualization and description
  • The user should be able to do offline check-out, It will provide flexibility and save time
  • Marketing team will require detail insight of user behavior in real time
  • As per recent regulation organization needs to keep the data for 10 years. In context to the same tool should provide cost effective solution for archiving 100 terabytes of data.

The company has some budgetary constraints along with the insufficient IT team size leading to the decision for outsourcing the tool development. Glaxyportal is now looking for high efficiency solution which will fulfill its above requirement.

Solution:

Figure 1. Conceptual Architecture

Above diagram is for indicative purpose only to outline the high-level architecture for eCommerce galaxyport.com. Architect understood the business criticality of the new solution. They identified two major problems; existing software products were best then but now outdated  and secondly current infrastructure isn't scalable to meet future and ad-hoc business demands. Galaxyportal was going through credit crunch, however their new solution has good future prospect. To meet the business demand architect decided to go ahead with the solution combination of SaaS and Cloud services. Serverless (no explicit infrastructure required, as in no servers, no deployments onto servers, no installed software of any kind.) architecture is an ideal approach for low maintenance solution. The architect decided to harness the power of AWS cloud services and proposed below architecture.

Figure 2 : Serverless Architecture in Cloud

Architecture proposed is very different from traditional one. The combination of SaaS with Cloud services makes complete solution as pay-as-you-go model which means Galaxyportal will be running on zero cost in case the services are not being used and hence the solution acts as a perfect fit in the current situation. Galaxyportal architect proposes uses of various AWS cloud services to achieve required results.

  1. Route 53 - will be used for DNS services
  2. ELB (elastic load balancer) - Both mobile app and web portal users will use services through AWS ELB
  3. EC2 Container Service - eCommerce Web and Admin portal will be deployed on it. They are highly scalable and support millions of hit for the web portal. At the same time, it eliminates the need of own cluster management infrastructure. EC2 Container Service also allows development team to seamlessly adopt DevOps
  4. Autoscaling - used to set-up EC2 Container . It's adjustable scalability property will scale container automatically depending upon the workload.
  5. Lambda - Instead of large monolithic business services, microservices architecture approach will be used to deliver business services. It will deliver business services without any provisioning of infrastructure
  6. API Gateway -  will be used to expose Lambda API business services. API Gateway will act as a "front door" for applications to access data, business logic code running on AWS Lambda. Mobile app will also use API Gateway to access business services.
  7. Cloud Search - Search is one of the most important features of eCommerce and AWS Cloud Search fulfills the criterion. It's a cost-effective and scalable solution
  8. Elasticache - For caching of frequently used information AWS Elasticache will be used
  9. SWF - will be used for any workflow related task e.g.; Order processing. SWF will be used along with Oracle Cloud ERP
  10. SNS Service -  All sorts of notification e.g.; Mobile, email will be made through it
  11. Dynamo DB - NoSQL database will be used for high volume transactional data
  12. S3 - All image and product videos will be available through S3.
  13. CDN - SaaS-based ECM product will be used for storing and delivering of static content. AWS CDN network will be used to cache the data at edge location for faster delivery to meet the demand of millions hit
  14. Cognito - The mobile app will have AWS Cognito capability to fulfil the demand of offline shopping through data synchronization
  15. Mobile Analytics - will be used to capture user behavior. It will pass the input to ElasticSearch for further analysis
  16. Kinesis - Real-time analytics is one of the key business requirements stated by Galaxyportal. Salesforce Marketing cloud will also be used to provide insight to a marketing department. AWS kinesis will be used to stream real-time input (e.g., click stream) to ElasticSearch to reveal insight from captured data.
  17. ElasticSearch -  will be used for real-time application monitoring, and click stream analytics to get better insight of user behavior in real time.
  18. Glacier - AWS Glacier is a low-cost archiving solution and will be used for archiving more than 100 terabytes of data
  19. Elastic Transcoder - will be used to convert images/videos into multi-format and multi-resolution.

With the above cost effective and scalable architecture, we can foresee more and more solutions heading towards serverless architecture. With the evolution of Cloud services, the thought process for creating architecture has got revamped and hence resulting in disrupting application architecture. The only drawback of this approach is lock-in with cloud vendor because the application is strongly tied to a cloud provider.

The intent of the above architecture is to explain how an enterprise application can be delivered using a serverless architecture. Above solution is designed using AWS. Azure is also providing similar services. Refer to my earlier blog AWS and Azure focused on Application Services. Azure services work in similar fashion and to get results replace AWS service with comparable Azure services.

More Stories By Amit Kumar

Amit Kumar is Manager Architect at CSC. In his current role, he is leading and mentoring a group of Architects. He acts as a consultant to both project delivery team and clients. His key focus areas are architecture governance and technical consulting. He demarcated structure approach for Architecture definition by breaking into four steps (Strategy, Requirement, Definition and Validation). He also conducts training on Solution Architecture, Application Guidance and Archimate training. He started his career in .NET and has played a role of Application architects for long now. He is passionate about Cloud computing and involved in client data centre migration on CSC cloud. He is an AWS Certified Solution Architect - Professional and a TOGAF Certified practitioner.

@ThingsExpo Stories
Mobile device usage has increased exponentially during the past several years, as consumers rely on handhelds for everything from news and weather to banking and purchases. What can we expect in the next few years? The way in which we interact with our devices will fundamentally change, as businesses leverage Artificial Intelligence. We already see this taking shape as businesses leverage AI for cost savings and customer responsiveness. This trend will continue, as AI is used for more sophistica...
Real IoT production deployments running at scale are collecting sensor data from hundreds / thousands / millions of devices. The goal is to take business-critical actions on the real-time data and find insights from stored datasets. In his session at @ThingsExpo, John Walicki, Watson IoT Developer Advocate at IBM Cloud, will provide a fast-paced developer journey that follows the IoT sensor data from generation, to edge gateway, to edge analytics, to encryption, to the IBM Bluemix cloud, to Wa...
What is the best strategy for selecting the right offshore company for your business? In his session at 21st Cloud Expo, Alan Winters, U.S. Head of Business Development at MobiDev, will discuss the things to look for - positive and negative - in evaluating your options. He will also discuss how to maximize productivity with your offshore developers. Before you start your search, clearly understand your business needs and how that impacts software choices.
SYS-CON Events announced today that Fusic will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Fusic Co. provides mocks as virtual IoT devices. You can customize mocks, and get any amount of data at any time in your test. For more information, visit https://fusic.co.jp/english/.
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that Enroute Lab will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enroute Lab is an industrial design, research and development company of unmanned robotic vehicle system. For more information, please visit http://elab.co.jp/.
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
SYS-CON Events announced today that Mobile Create USA will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Mobile Create USA Inc. is an MVNO-based business model that uses portable communication devices and cellular-based infrastructure in the development, sales, operation and mobile communications systems incorporating GPS capabi...
There is huge complexity in implementing a successful digital business that requires efficient on-premise and cloud back-end infrastructure, IT and Internet of Things (IoT) data, analytics, Machine Learning, Artificial Intelligence (AI) and Digital Applications. In the data center alone, there are physical and virtual infrastructures, multiple operating systems, multiple applications and new and emerging business and technological paradigms such as cloud computing and XaaS. And then there are pe...
SYS-CON Events announced today that Interface Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Interface Corporation is a company developing, manufacturing and marketing high quality and wide variety of industrial computers and interface modules such as PCIs and PCI express. For more information, visit http://www.i...
SYS-CON Events announced today that Keisoku Research Consultant Co. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Keisoku Research Consultant, Co. offers research and consulting in a wide range of civil engineering-related fields from information construction to preservation of cultural properties. For more information, vi...
SYS-CON Events announced today that SIGMA Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. uLaser flow inspection device from the Japanese top share to Global Standard! Then, make the best use of data to flip to next page. For more information, visit http://www.sigma-k.co.jp/en/.
SYS-CON Events announced today that B2Cloud will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. B2Cloud specializes in IoT devices for preventive and predictive maintenance in any kind of equipment retrieving data like Energy consumption, working time, temperature, humidity, pressure, etc.
Agile has finally jumped the technology shark, expanding outside the software world. Enterprises are now increasingly adopting Agile practices across their organizations in order to successfully navigate the disruptive waters that threaten to drown them. In our quest for establishing change as a core competency in our organizations, this business-centric notion of Agile is an essential component of Agile Digital Transformation. In the years since the publication of the Agile Manifesto, the conn...
While some developers care passionately about how data centers and clouds are architected, for most, it is only the end result that matters. To the majority of companies, technology exists to solve a business problem, and only delivers value when it is solving that problem. 2017 brings the mainstream adoption of containers for production workloads. In his session at 21st Cloud Expo, Ben McCormack, VP of Operations at Evernote, will discuss how data centers of the future will be managed, how th...
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp em...
SYS-CON Events announced today that Nihon Micron will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Nihon Micron Co., Ltd. strives for technological innovation to establish high-density, high-precision processing technology for providing printed circuit board and metal mount RFID tags used for communication devices. For more inf...
SYS-CON Events announced today that Suzuki Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Suzuki Inc. is a semiconductor-related business, including sales of consuming parts, parts repair, and maintenance for semiconductor manufacturing machines, etc. It is also a health care business providing experimental research for...
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...
SYS-CON Events announced today that Daiya Industry will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Daiya Industry specializes in orthotic support systems and assistive devices with pneumatic artificial muscles in order to contribute to an extended healthy life expectancy. For more information, please visit https://www.daiyak...