Incident Report: VisualDLP Performance Issues 5/1 - 5/4

Incident Report: VisualDLP Performance Issues 5/1 - 5/4

Incident ReportVisualDLP Performance Issues 5/1 - 5/4 

 

Background 


Two weeks ago, EasyRx implemented a best-practice maintenance plan on the VisuallDLP datastore. This plan has led to overall improvements in system performance and reduced latency. However, between May 1st - 4th, there were several periods (see Figure 1 below) when the VisualDLP database utilization reached 100%. This caused the system to be inaccessible while this was occurring. 


Identification 

Using query performance tools available in our Microsoft Azure Cloud environment, we were able to identify a query request being made from the application that was identified as a slow running query and accounted for an exceptionally high percentage of processing time(see Figure 2 below). 

 

Mitigation 


Once the slow performing query was identified, it was disabled on 5/4/2023 at approximately 5:00pm CSTWe believe the database maintenance that was performed changed the execution plan of this performing query and led to this issueWe are monitoring the system closely and have created new alerts that will identify any other slow performing queries that may arise.  

 

Figure 1Database Resource Utilization April 24 – May 4th. 

 

 

 

 

Figure 2 Slow Running Query 

 

 

 

Figure 3 Slow Performing Query Execution Time on 5/4/23 

 

 

 

As always, please contact us if you have any issues or concerns.  
 
The EasyRx /VisualDLP Team 


    • Related Articles

    • 2024 VisualDLP Updates

      Below is a running list of the enhancements and bug fixes for VisualDLP released in 2024 February Doctor Preferences Improvements Exclude Inactive Doctors and Accounts from Exports Accounts API or Add Fields to GetDoctorsList - Accutech Special Price ...
    • DL-Plus User's Guide (Build 2.2.400) - Full Doc

      DL-Plus User’s Guide (Build 2.2.400) Copyright © 2014 Jenmar International, Inc. All rights reserved.  Information in this document is subject to change without notice. No part of it may be copied, reproduced, translated, transmitted, or reduced to ...
    • Jenmar VisualDLP Service Message Page

      No Current Service Issues  Service History  4/1 Summary:  Between 22:35 UTC and 23:30 UTC VisualDLP was unavailable for some users.  The symptoms of the issue included slow and sometimes non-responsive loading for users logged into VisualDLP and ...
    • 2019-08 August Update

      Below is a summary of the enhancements and bug fixes found in our latest update of VisualDLP A complete Audit history has been added to the Order Entry page.  You can now track almost every change made to an order and see when it was made and by ...
    • 2020-03 March Update

      Below is a summary of the enhancements and bug fixes found in our latest update of VisualDLP Redesigned Account Overview Screen.  Shows open balances, running total and how payment were applied to invoices.  Also includes a printable version to email ...