Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: BenAdmin
    • Labels:
      None
    • Environment:
      Production
    • Bug Severity:
      Medium
    • Module:
      Platform
    • Reported by:
      Client
    • Company:
      All Clients/Multiple Clients
    • Item State:
      LB QA - LB Deployed
    • Reported by Customer:
      BCC and Shreveport

      Description

      I am getting calls regarding both stage and production

      1. Stage - running very slow. The system is displaying the loader for long time
      2. Production - Kicking the user out randomly. I experienced this in University Health. I was on an employee page clicked to search for another employee and I was kick out and had to log back in

      Yamilka CocaDeborah MascotDeborah LarueKevin Walker

        Attachments

          Activity

          Hide
          samir Samir added a comment -

          Please check Stage on priority

          Debbie Kulling
          Production: Idle timeout is 15 minutes as per Hitrust requirement JIRA ID WT-10727

          Nandkumar Prabhakar KarlekarIndraprakash Tiwari

          Show
          samir Samir added a comment - Please check Stage on priority Debbie Kulling Production: Idle timeout is 15 minutes as per Hitrust requirement JIRA ID WT-10727 Nandkumar Prabhakar Karlekar Indraprakash Tiwari
          Hide
          Vinayak.Kulkarni Vinayak Kulkarni (Inactive) added a comment -

          Hi Debbie Kulling

          We are accessing stage site and its working fine at our end. Please let us know if there is any specific page/area getting more time to respond. Thanks.

          Show
          Vinayak.Kulkarni Vinayak Kulkarni (Inactive) added a comment - Hi Debbie Kulling We are accessing stage site and its working fine at our end. Please let us know if there is any specific page/area getting more time to respond. Thanks.
          Hide
          Vinayak.Kulkarni Vinayak Kulkarni (Inactive) added a comment -

          Hi,

          Below are steps by which we could able to repro log-out issue, However the behavior is not same every time.

          1] Log in into system ( we used Edge browser and partner login)
          2] select company and stay idle for 5 minutes
          3] click on BenAdmin tile, this is when system threw me out couple of times.

          Show
          Vinayak.Kulkarni Vinayak Kulkarni (Inactive) added a comment - Hi, Below are steps by which we could able to repro log-out issue, However the behavior is not same every time. 1] Log in into system ( we used Edge browser and partner login) 2] select company and stay idle for 5 minutes 3] click on BenAdmin tile, this is when system threw me out couple of times.
          Hide
          satyap Satya added a comment -

          Hi Rakesh,

          As discussed, can you please get this verified on multiple browsers & login. Please share your findings.

          Regards,
          Satya Prakash

          Cc: Samir Jaideep Vinchurkar Bharti Satpute

          Show
          satyap Satya added a comment - Hi Rakesh, As discussed, can you please get this verified on multiple browsers & login. Please share your findings. Regards, Satya Prakash Cc: Samir Jaideep Vinchurkar Bharti Satpute
          Hide
          rakeshr Rakesh Roy (Inactive) added a comment -

          Sanjana Jadhav Could you please check log out behaviour of system on production which is changed after Hi trust recommendation?

          Mainy target Edge , IE and Chrome browser.

          Prasad PiseHrishikesh Deshpande

          Show
          rakeshr Rakesh Roy (Inactive) added a comment - Sanjana Jadhav Could you please check log out behaviour of system on production which is changed after Hi trust recommendation? Mainy target Edge , IE and Chrome browser. Prasad Pise Hrishikesh Deshpande
          Hide
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment - - edited

          Hi Satya

          Verified on Chrome, IE 10 and Edge.
          Verified for following login:partner, Broker, admin and employee
          Verified stage and production behaviour.
          1.stage response time is more than production but it does not take too much time to respond
          2.Not able to repro logout issue-follow same step mentioned in above comment .(Verified same for partner, Broker, admin and employee login)
          3.Verified session timeout - session expired after 15 minute - need to login again after session timeout -> Pass

          CC: Rakesh Roy Prasad Pise Hrishikesh Deshpande Sachin Hingole Samir Vinayak Kulkarni Jaideep Vinchurkar Bharti Satpute Saurabh Sablaka

          Thanks,
          Sanjana Jadhav

          Show
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment - - edited Hi Satya Verified on Chrome, IE 10 and Edge. Verified for following login:partner, Broker, admin and employee Verified stage and production behaviour. 1.stage response time is more than production but it does not take too much time to respond 2.Not able to repro logout issue-follow same step mentioned in above comment .(Verified same for partner, Broker, admin and employee login) 3.Verified session timeout - session expired after 15 minute - need to login again after session timeout -> Pass CC: Rakesh Roy Prasad Pise Hrishikesh Deshpande Sachin Hingole Samir Vinayak Kulkarni Jaideep Vinchurkar Bharti Satpute Saurabh Sablaka Thanks, Sanjana Jadhav
          Hide
          satyap Satya added a comment -

          In Addition to above points, development team also verified below points on production today, however did not find any logout issue for the same:

          1. Verified patch points related to session on all web servers
          2. Access system from multiple login roles
          3. Keep system in idle state for 5/10/15 mins on Chrome, Edge & IE
          4. Access site with individual IP address and keep in idle state
          5. Verified session generation and user flag reset from backend
          6. Checked that requests are distributed across all servers in load test of 200 users

          After this we tried logging in with 10-11 partner users by putting load of 500 users on Production. In this scenario also, couldn’t reproduce this. We are checking for more feasibility for this logout issue to occur- however in case any additional details or steps, please share with us. It will help fix this issue on priority.

          Rakesh Roy - Please schedule call with Samir to get repro steps.

          Regards,
          Satya Prakash

          Cc: Swapnil Pandhare Saurabh Sablaka Ashwin Wankhede Bharti Satpute Samir

          Show
          satyap Satya added a comment - In Addition to above points, development team also verified below points on production today, however did not find any logout issue for the same: 1. Verified patch points related to session on all web servers 2. Access system from multiple login roles 3. Keep system in idle state for 5/10/15 mins on Chrome, Edge & IE 4. Access site with individual IP address and keep in idle state 5. Verified session generation and user flag reset from backend 6. Checked that requests are distributed across all servers in load test of 200 users After this we tried logging in with 10-11 partner users by putting load of 500 users on Production. In this scenario also, couldn’t reproduce this. We are checking for more feasibility for this logout issue to occur- however in case any additional details or steps, please share with us. It will help fix this issue on priority. Rakesh Roy - Please schedule call with Samir to get repro steps. Regards, Satya Prakash Cc: Swapnil Pandhare Saurabh Sablaka Ashwin Wankhede Bharti Satpute Samir
          Hide
          satyap Satya added a comment -

          Below are some more information on Root cause:

          Root Cause:

          User’s last session data/details could not be fetched from System utilization table and which forced the user to be logged out of the system

          Reason 1:
          In User’s table “Isactive” flag was set to 1, however, user was not logged into the system, this entry could have occurred due to an unexpected event of cluster failure or “system recycle” (workaround to reduce the system overload/utilization) resulting in “Isactive” flag was not being reset to 0

          Reason 2:

          2016 system utilization table data were deleted from main table (routine performed for monitoring 2017 system utilization), due to which last session ID of the active users could not be fetched and resulted in killing of all present user session

          Cc: Gaurav Sodani Jennifer Reed

          Show
          satyap Satya added a comment - Below are some more information on Root cause: Root Cause: User’s last session data/details could not be fetched from System utilization table and which forced the user to be logged out of the system Reason 1: In User’s table “Isactive” flag was set to 1, however, user was not logged into the system, this entry could have occurred due to an unexpected event of cluster failure or “system recycle” (workaround to reduce the system overload/utilization) resulting in “Isactive” flag was not being reset to 0 Reason 2: 2016 system utilization table data were deleted from main table (routine performed for monitoring 2017 system utilization), due to which last session ID of the active users could not be fetched and resulted in killing of all present user session Cc: Gaurav Sodani Jennifer Reed
          Hide
          Jennifer.Reed Jennifer Reed (Inactive) added a comment -

          Satya Thanks for this update - are we saying that the root cause was both of these? Or are we trying to determine which one, and these are theories as to what may have happened?

          Show
          Jennifer.Reed Jennifer Reed (Inactive) added a comment - Satya Thanks for this update - are we saying that the root cause was both of these? Or are we trying to determine which one, and these are theories as to what may have happened?
          Hide
          satyap Satya added a comment -

          Hi Nandu,

          Can you please share your views on Jenn's query?

          Regards,
          Satya Prakash

          Cc: Samir Bharti Satpute Gaurav Sodani Rakesh Roy

          Show
          satyap Satya added a comment - Hi Nandu, Can you please share your views on Jenn's query? Regards, Satya Prakash Cc: Samir Bharti Satpute Gaurav Sodani Rakesh Roy
          Hide
          Jennifer.Reed Jennifer Reed (Inactive) added a comment -

          Samir Satya Have we made any progress on the root causes?

          Show
          Jennifer.Reed Jennifer Reed (Inactive) added a comment - Samir Satya Have we made any progress on the root causes?
          Hide
          nandkumar Nandkumar Prabhakar Karlekar (Inactive) added a comment -

          Hi Jennifer Reed,

          We have completely fixed this issue and deployed at all environment . This is very specific problem hidden in user login related data.

          Please find the attached analysis document for detail.

          User Kick out Issue Analysis.docx

          Please let me know if you need more information for the same.

          Satya,Samir

          Thanks
          Nandkumar

          Show
          nandkumar Nandkumar Prabhakar Karlekar (Inactive) added a comment - Hi Jennifer Reed , We have completely fixed this issue and deployed at all environment . This is very specific problem hidden in user login related data. Please find the attached analysis document for detail. User Kick out Issue Analysis.docx Please let me know if you need more information for the same. Satya , Samir Thanks Nandkumar

            People

            Assignee:
            nandkumar Nandkumar Prabhakar Karlekar (Inactive)
            Reporter:
            dkulling Debbie Kulling
            Account Executive:
            Debbie Kulling
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

              Dates

              Created:
              Updated:

                Time Tracking

                Estimated:
                Original Estimate - 0h
                0h
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 125.05h
                125.05h