Welcome!

FinTech Journal Authors: Elizabeth White, Zakia Bouachraoui, Yeshim Deniz, Liz McMillan, Pat Romanski

Related Topics: FinTech Journal, @DevOpsSummit

FinTech Journal: Article

Log-level Usage Reports | @DevOpsSummit #DevOps #Docker #Monitoring

The reports can give you an intelligent breakdown of your log volumes by application, server, process

What You Can Learn From Log-level Usage Reports

Separating the signal from the noise is one of the biggest challenges when dealing with machine-generated log data today and has generally required deep technical expertise. However once you find that signal it can be massively useful and can help you make business decisions with a big impact. Today Logentries is announcing log level usage reports, which is one more way we are striving to do the hard work so you don't have to!

log-level-usage-reports

At first glance, log-level usage reports might seem quite rudimentary insofar as they are weekly reports of the log volumes you send to Logentries. However, the reports can give you an intelligent breakdown of your log volumes by application, server, process as well as at the individual log level.The usage reports are designed to provide IT and Dev Ops teams with a weekly snapshot of their system activity broken down at a very fine-grained log level giving the ability to see interesting trends in system behavior. In fact, so many of our customers have been asking our newLogentries Data Insights team to run these reports that we've decided to make them widely available. The reports are part of a new service being produced by this team comprised of PhDs and applied research scientists in distributed systems,  and they are supported by Logentries proprietary machine learning and community analytics technology.

Over the past few months we have  used these reports to help a large number of our customers to investigate spikes in system load, potential issues as well as to understand business trends and how they relate to their systems - and might I add with phenomenal results -  based on some really simple analysis. I suppose it doesn't need to be complex to be valuable...

But don't take my word for it...according to Rich Archbold, director of Ops at Intercom

"The new Logentries Log Analytics Reporting service has provided us with insight into our environment that we would never have been able to get before. We now have deep, log-level visibility into application activity, trends, and potential issues on a weekly basis delivered right into our inbox!"

Specifically the usage reports will provide the following:

  • Total number of logs and log sets
  • Total log volume across all logs
  • Top 20 logs by volume
  • Daily breakdown of log volume per log
  • List of inactive logs

Screen Shot 2015-05-07 at 9.55.22 AM

Sample Usage Report
The new reports can be especially useful for:

  • Logging cost analysis: When your log volumes increase significantly you usually want to know why. Looking at your total log volumes will generally not give enough insight to allow you to figure out what has caused the increase or from what part of your system the increase is coming from. However by getting a breakdown of your top 20 logs by volume you can immediately see the log or logs responsible, allowing you to take the next step in determining as to whether this was a result of increased system load or whether this was related to a system issue or rogue process.
  • System load analysis: Log volumes are a great indicator for understanding system load. As load increases so too do your log volumes. Understanding what log(s) are resulting in the increased load will give you better visibility into what part of your system is actually seeing the increased workloads.
  • Troubleshooting: The most common cause of a sudden spike in log volumes is generally not sudden increased  load on a system, but unfortunately is more often a result of a misconfiguration or application bug that starts to produce cascading errors. A sudden spike from a specific log is often an indicator of issues emanating from a particular application component. Similarly if logs suddenly become inactive, it may signify something has gone horribly wrong.
  • Infrastructure usage analysis: When your cloud bills start to grow, it is common for CFOs and IT leads to sit down weekly/monthly to understand what is driving this. This has been notoriously difficult in the past and has resulted in the rise of companies like cloudability and cloudtechhealth for example. Looking at your cloud costs breakdown along side log level usage data can help you correlate and understand some of the drivers behind these costs, especially if there has been significant change in your cloud cost structure.

To sign up for your weekly log level usage report simply go here and provide your details.


10-ways-to-lead-with-analytics

Sign-up for a free 30 Day Trial

Get set up in minutes, and gain insights in seconds

Start Free Trial Setup a Demo

More Stories By Trevor Parsons

Trevor Parsons is Chief Scientist and Co-founder of Logentries. Trevor has over 10 years experience in enterprise software and, in particular, has specialized in developing enterprise monitoring and performance tools for distributed systems. He is also a research fellow at the Performance Engineering Lab Research Group and was formerly a Scientist at the IBM Center for Advanced Studies. Trevor holds a PhD from University College Dublin, Ireland.

IoT & Smart Cities Stories
DXWorldEXPO LLC announced today that Telecom Reseller has been named "Media Sponsor" of CloudEXPO | DXWorldEXPO 2018 New York, which will take place on November 11-13, 2018 in New York City, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
In this Women in Technology Power Panel at 15th Cloud Expo, moderated by Anne Plese, Senior Consultant, Cloud Product Marketing at Verizon Enterprise, Esmeralda Swartz, CMO at MetraTech; Evelyn de Souza, Data Privacy and Compliance Strategy Leader at Cisco Systems; Seema Jethani, Director of Product Management at Basho Technologies; Victoria Livschitz, CEO of Qubell Inc.; Anne Hungate, Senior Director of Software Quality at DIRECTV, discussed what path they took to find their spot within the tec...
To Really Work for Enterprises, MultiCloud Adoption Requires Far Better and Inclusive Cloud Monitoring and Cost Management … But How? Overwhelmingly, even as enterprises have adopted cloud computing and are expanding to multi-cloud computing, IT leaders remain concerned about how to monitor, manage and control costs across hybrid and multi-cloud deployments. It’s clear that traditional IT monitoring and management approaches, designed after all for on-premises data centers, are falling short in ...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
Discussions of cloud computing have evolved in recent years from a focus on specific types of cloud, to a world of hybrid cloud, and to a world dominated by the APIs that make today's multi-cloud environments and hybrid clouds possible. In this Power Panel at 17th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists addressed the importance of customers being able to use the specific technologies they need, through environments and ecosystems that expose their APIs to make true ...
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
We are seeing a major migration of enterprises applications to the cloud. As cloud and business use of real time applications accelerate, legacy networks are no longer able to architecturally support cloud adoption and deliver the performance and security required by highly distributed enterprises. These outdated solutions have become more costly and complicated to implement, install, manage, and maintain.SD-WAN offers unlimited capabilities for accessing the benefits of the cloud and Internet. ...
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and G...
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.