Details

    • Type: Bug
    • Status: Closed
    • Priority: Medium
    • Resolution: Bug Fixed
    • Labels:
      None
    • Environment:
      Production
    • Categories:
      ACA - ACA IRS Reports
    • Company:
      HPB
    • Reported by:
      Client

      Description

      Hi Smita -

      The consolidated run for HPB doesn't look right. The final run has 3703 forms but the merged reports only equal about 1,903 forms (merged 1 has 1080 pages, 2 has 864, 3 has 144, 4 has 1584, 5 has 936, 6 has 1512, 7 has 1440, 8 has 474, 9 has 792, 10 has 864, 11 has 1080, 12 has 504 and 13 has 144 which only equals 11,418 pages or 1,903 forms).

      This is a huge problem and I'm worried about all of the other reports we consolidated.

      Please check into this ASAP and please verify that no other client has this same issue. We also need to know what forms were missed for HPB as we need to get a file to them to send the rest of the forms out.

      Amanda Hagan

        Attachments

        1. Scenario.xls
          12 kB
        2. screenshot-1.png
          screenshot-1.png
          15 kB
        3. WB-325.xls
          14 kB
        4. WB-325-FileList.txt
          2 kB

          Activity

          Hide
          nidhi.kaul Nidhi Kaul (Inactive) added a comment -

          Ramya Tantry
          Please take this on top priority as the issue is reported as critical

          Satya

          Show
          nidhi.kaul Nidhi Kaul (Inactive) added a comment - Ramya Tantry Please take this on top priority as the issue is reported as critical Satya
          Hide
          ramya.tantry Ramya Tantry (Inactive) added a comment -

          Hi Jennifer Leugers,

          We have scanned all companies and we have found two companies where consolidated forms were not proper.
          Companies are Karma (663 employees missing) and HPB(1800 employees missing).
          We have re-run the consolidated for the employees that were missed in previous consolidated report and uploaded the zip files on FTP.
          Path:
          Karma: /users/workterraaca/_Tax Year 2017/Karma
          File name : Karma_New_2017_663_20180306052322_5176_Collective.zip

          HPB : /users/workterraaca/_Tax Year 2017/HPB
          File name: HPB_2017_1802_20180306061139_5176_Collective.zip

          We have also run full consolidated forms on Karma and HPB
          For Karma : Consolidated Report Name: New Karma Consolidated 2017
          For HPB : Consolidated report Name : New HPB Consolidated 2017

          We are trying to reproduce this issue and will update you on 3C's soon.

          CC:Nidhi Kaul,Nandkumar Prabhakar Karlekar

          Show
          ramya.tantry Ramya Tantry (Inactive) added a comment - Hi Jennifer Leugers , We have scanned all companies and we have found two companies where consolidated forms were not proper. Companies are Karma (663 employees missing) and HPB(1800 employees missing). We have re-run the consolidated for the employees that were missed in previous consolidated report and uploaded the zip files on FTP. Path : Karma : /users/workterraaca/_Tax Year 2017/Karma File name : Karma_New_2017_663_20180306052322_5176_Collective.zip HPB : /users/workterraaca/_Tax Year 2017/HPB File name : HPB_2017_1802_20180306061139_5176_Collective.zip We have also run full consolidated forms on Karma and HPB For Karma : Consolidated Report Name: New Karma Consolidated 2017 For HPB : Consolidated report Name : New HPB Consolidated 2017 We are trying to reproduce this issue and will update you on 3C's soon. CC: Nidhi Kaul , Nandkumar Prabhakar Karlekar
          Hide
          jennifer.leugers Jennifer Leugers added a comment -

          Hi all - we also need to know why on the front screen it shows the # of forms which is not accurate given the # of forms I was expecting but obviously not indicative of how many forms we actually did.

          Show
          jennifer.leugers Jennifer Leugers added a comment - Hi all - we also need to know why on the front screen it shows the # of forms which is not accurate given the # of forms I was expecting but obviously not indicative of how many forms we actually did.
          Hide
          ramya.tantry Ramya Tantry (Inactive) added a comment -

          Hi Jennifer Leugers,

          On the UI,total employees in the run is calculated and is shown on the grid under Total EE count.In case if any filter is applied to the report,then that employee count is shown under Filtered EE count.
          As per current implementation, actual count of PDF's in consolidated is not stored in the system.

          We have added this in our learning and will analyze it further.

          CC:Nandkumar Prabhakar Karlekar

          Show
          ramya.tantry Ramya Tantry (Inactive) added a comment - Hi Jennifer Leugers , On the UI,total employees in the run is calculated and is shown on the grid under Total EE count.In case if any filter is applied to the report,then that employee count is shown under Filtered EE count. As per current implementation, actual count of PDF's in consolidated is not stored in the system. We have added this in our learning and will analyze it further. CC: Nandkumar Prabhakar Karlekar
          Hide
          ramya.tantry Ramya Tantry (Inactive) added a comment -

          Hi Mahendra Mungase,

          Please repro the issue of employees missing in consolidated forms and update the scenario.

          Show
          ramya.tantry Ramya Tantry (Inactive) added a comment - Hi Mahendra Mungase , Please repro the issue of employees missing in consolidated forms and update the scenario.
          Hide
          mahendra.mungase Mahendra Mungase (Inactive) added a comment -

          We are in process of reproducing the issue and will update scenario tomorrow EOD.

          Thanks,
          Mahendra

          Show
          mahendra.mungase Mahendra Mungase (Inactive) added a comment - We are in process of reproducing the issue and will update scenario tomorrow EOD. Thanks, Mahendra
          Hide
          mahendra.mungase Mahendra Mungase (Inactive) added a comment -

          Hi Ramya Tantry

          We had tried multiple scenarios and Browser, we got the issue only in below scenario

          1.Login with Partner
          2.Navigate to ACA > Setting > ACA 1095C Acknowledgement
          3.Select 1095C report
          4.Click on Add New
          5.Enter all details and click on Save & Consolidated Download
          6.Close tab when “Unzipping Files In Progress” step started
          7.Again login and run the same report.
          8.If during processing report if you come across Server Error then just click on OK
          9.It displays our report page and just clicks on Cancel button
          10.Again Edit the same report and click on Save & Consolidated Download
          11.After run, download zip folder
          12.Check EE count in consolidated report

          Error Log -

          ErrorID : 0
          ErrorSource : ControllerAppTier.SaveAndGetData->BenAdminControllerAppTier.SaveAndGetData->IRSReport.SaveAndGetData->IRSReport.CheckForReport->IRSReport.ProcessIRSReport->Employee1095CReport.GeneratePDFForMultipleEmployeeAdminLevel
          ErrorMessage:

          For More details please find attached sheet - Scenario.xls

          Thanks,
          Mahendra

          Show
          mahendra.mungase Mahendra Mungase (Inactive) added a comment - Hi Ramya Tantry We had tried multiple scenarios and Browser, we got the issue only in below scenario 1.Login with Partner 2.Navigate to ACA > Setting > ACA 1095C Acknowledgement 3.Select 1095C report 4.Click on Add New 5.Enter all details and click on Save & Consolidated Download 6.Close tab when “Unzipping Files In Progress” step started 7.Again login and run the same report. 8.If during processing report if you come across Server Error then just click on OK 9.It displays our report page and just clicks on Cancel button 10.Again Edit the same report and click on Save & Consolidated Download 11.After run, download zip folder 12.Check EE count in consolidated report Error Log - ErrorID : 0 ErrorSource : ControllerAppTier.SaveAndGetData->BenAdminControllerAppTier.SaveAndGetData->IRSReport.SaveAndGetData->IRSReport.CheckForReport->IRSReport.ProcessIRSReport->Employee1095CReport.GeneratePDFForMultipleEmployeeAdminLevel ErrorMessage: For More details please find attached sheet - Scenario.xls Thanks, Mahendra
          Hide
          ramya.tantry Ramya Tantry (Inactive) added a comment -

          Hi Jennifer Reed,

          This issue affected only 2 companies on Production and when we re-run the consolidated forms,it was executed successfully. So there is no hot fix or workaround required for generating these forms.
          The scenario mentioned by QA is a very rare scenario and we are working on analyzing its fix.
          However, we think that as this is not a Blocker issue, it can be moved to Medium Priority from Critical.

          CC: Satya,Nandkumar Prabhakar Karlekar,Prashant Samal,Mahendra Mungase,Jennifer Leugers

          Show
          ramya.tantry Ramya Tantry (Inactive) added a comment - Hi Jennifer Reed , This issue affected only 2 companies on Production and when we re-run the consolidated forms,it was executed successfully. So there is no hot fix or workaround required for generating these forms. The scenario mentioned by QA is a very rare scenario and we are working on analyzing its fix. However, we think that as this is not a Blocker issue, it can be moved to Medium Priority from Critical. CC: Satya , Nandkumar Prabhakar Karlekar , Prashant Samal , Mahendra Mungase , Jennifer Leugers
          Hide
          satyap Satya added a comment -

          Changing priority to Medium, since this occurs in rare scenarios & there is workaround for this report.

          Regards,
          Satya Prakash

          Cc: Jennifer Reed Ramya Tantry

          Show
          satyap Satya added a comment - Changing priority to Medium, since this occurs in rare scenarios & there is workaround for this report. Regards, Satya Prakash Cc: Jennifer Reed Ramya Tantry
          Hide
          Amanda.Hagan Amanda Hagan (Inactive) added a comment -

          HI Ramya Tantry, is there a root cause that we can provide to the client/broker as an explanation as to why this occurred? They are requesting an explanation for why the consolidated report only generated half of their 1095c reports.

          Jackie Sivigny Yamilka Coca Robyn Adkison

          Show
          Amanda.Hagan Amanda Hagan (Inactive) added a comment - HI Ramya Tantry , is there a root cause that we can provide to the client/broker as an explanation as to why this occurred? They are requesting an explanation for why the consolidated report only generated half of their 1095c reports. Jackie Sivigny Yamilka Coca Robyn Adkison
          Hide
          ramya.tantry Ramya Tantry (Inactive) added a comment -

          3C's

          Concern: Consolidated report generated half of their 1095C report.
          Cause: On click of Save and Consolidated button,the finalized 1095C zip file is extracted and batchwise merging of reports starts(300 employees in a batch).
          Here, 300 employees from the extracted folder is removed and given to PDF service to merge them. If this process results in log out due to timeout or error,the extracted folder is not deleted and it remains on file server.
          Next time if user starts another process by clicking Save and Consolidated button,then the same extracted folder(which now contains less employees) is used to process the consolidated report.
          Correction: We will be deleting the extracted folder every time if there is log out due to timeout or error and we will additionally implement a way wherein the multiple users can process the consolidated report parallely.

          CC:Amanda Hagan,Robyn Adkison,Yamilka Coca,Jackie Sivigny,Satya,Nandkumar Prabhakar Karlekar,Mahendra Mungase

          Show
          ramya.tantry Ramya Tantry (Inactive) added a comment - 3C's Concern : Consolidated report generated half of their 1095C report. Cause : On click of Save and Consolidated button,the finalized 1095C zip file is extracted and batchwise merging of reports starts(300 employees in a batch). Here, 300 employees from the extracted folder is removed and given to PDF service to merge them. If this process results in log out due to timeout or error,the extracted folder is not deleted and it remains on file server. Next time if user starts another process by clicking Save and Consolidated button,then the same extracted folder(which now contains less employees) is used to process the consolidated report. Correction : We will be deleting the extracted folder every time if there is log out due to timeout or error and we will additionally implement a way wherein the multiple users can process the consolidated report parallely. CC: Amanda Hagan , Robyn Adkison , Yamilka Coca , Jackie Sivigny , Satya , Nandkumar Prabhakar Karlekar , Mahendra Mungase
          Hide
          ramya.tantry Ramya Tantry (Inactive) added a comment -

          Hi Smita Pawar,

          This has been deployed on codemap.Please verify.

          Changes Done are:
          1. Added a new column "Consolidate Zip Date Time" in Acknowledgement Grid to show the date timestamp of consolidated zip file.
          2. Report Locking- At a given point of time only one instance of report for a finalized report run will be processed
          3. Extracted zip folder will be deleted from the server in case of error.

          Affected file list attached: WB-325-FileList.txt

          Show
          ramya.tantry Ramya Tantry (Inactive) added a comment - Hi Smita Pawar , This has been deployed on codemap.Please verify. Changes Done are: 1. Added a new column "Consolidate Zip Date Time" in Acknowledgement Grid to show the date timestamp of consolidated zip file. 2. Report Locking- At a given point of time only one instance of report for a finalized report run will be processed 3. Extracted zip folder will be deleted from the server in case of error. Affected file list attached: WB-325-FileList.txt
          Hide
          mahendra.mungase Mahendra Mungase (Inactive) added a comment - - edited

          Hi Ramya Tantry

          During consolidated issue testing on CodeMap, we found following issues.

          1.Server error during processing of Save and Consolidated
          Step:-
          1.Login to application
          2.Navigate to ACA >> Setting >> ACA 1095-C Acknowledgement
          3.Select 95C Report
          4.Click on Add New
          5.Enter all details and click on Save
          6.It redirects to back
          7.Edit same report
          8.Click on Save and Consolidated Download
          9.When Processing reach to second step Unzipping - close the tab
          10.Login again
          11.Navigate to the same page
          12.Select other 1095C from list
          13.Fill all details and click on Save and Consolidated Download
          14.Processing started
          Actual - During processing system throw server error
          Expected - Consolidated report should complete
          Error Message:
          Inner Exeception:
          ErrorSource : InvoiceManagement
          Error Log: at WORKTERRA.IRSReport.ProcessConsolidatedPDFFromPDFService(List`1 objListDynamic, StaticReport objStaticReport)
          at WORKTERRA.IRSReport.ProcessIRSReport(StaticReport objStaticReport, Hashtable I_Criteria, Object I_context)

          2.Server Error during processing of Save and Download
          Step:-
          1.Login to application
          2.Navigate to ACA >> Setting >> ACA 1095-C Acknowledgement
          3.Select 95C Report
          4.Click on Add New
          5.Enter all details and click on Save
          6.It redirects to back
          7.Edit same report
          8.Click on Save and Download
          Actual - After some time Server Error populated on screen
          Expected- It should run completely without error
          ErrorID : 0
          ErrorSource : ControllerAppTier.SaveAndGetData->BenAdminControllerAppTier.SaveAndGetData->IRSReport.SaveAndGetData->IRSReport.CheckForReport->IRSReport.ProcessIRSReport->Employee1095CReport.GeneratePDFForMultipleEmployeeAdminLevel
          ErrorMessage:

          Hence reopening the same.

          Thanks,
          Mahendra

          Show
          mahendra.mungase Mahendra Mungase (Inactive) added a comment - - edited Hi Ramya Tantry During consolidated issue testing on CodeMap, we found following issues. 1.Server error during processing of Save and Consolidated Step:- 1.Login to application 2.Navigate to ACA >> Setting >> ACA 1095-C Acknowledgement 3.Select 95C Report 4.Click on Add New 5.Enter all details and click on Save 6.It redirects to back 7.Edit same report 8.Click on Save and Consolidated Download 9.When Processing reach to second step Unzipping - close the tab 10.Login again 11.Navigate to the same page 12.Select other 1095C from list 13.Fill all details and click on Save and Consolidated Download 14.Processing started Actual - During processing system throw server error Expected - Consolidated report should complete Error Message: Inner Exeception: ErrorSource : InvoiceManagement Error Log: at WORKTERRA.IRSReport.ProcessConsolidatedPDFFromPDFService(List`1 objListDynamic, StaticReport objStaticReport) at WORKTERRA.IRSReport.ProcessIRSReport(StaticReport objStaticReport, Hashtable I_Criteria, Object I_context) 2.Server Error during processing of Save and Download Step:- 1.Login to application 2.Navigate to ACA >> Setting >> ACA 1095-C Acknowledgement 3.Select 95C Report 4.Click on Add New 5.Enter all details and click on Save 6.It redirects to back 7.Edit same report 8.Click on Save and Download Actual - After some time Server Error populated on screen Expected- It should run completely without error ErrorID : 0 ErrorSource : ControllerAppTier.SaveAndGetData->BenAdminControllerAppTier.SaveAndGetData->IRSReport.SaveAndGetData->IRSReport.CheckForReport->IRSReport.ProcessIRSReport->Employee1095CReport.GeneratePDFForMultipleEmployeeAdminLevel ErrorMessage: Hence reopening the same. Thanks, Mahendra
          Hide
          ramya.tantry Ramya Tantry (Inactive) added a comment -

          Hi Mahendra Mungase,

          On Codemap(LB) environment,there is only one PDF service,whereas Pre-prod and Prod has 2 PDF services.

          If there are multiple requests for single PDF service,It will give server error as it cannot bear the load of multiple requests. Above mentioned scenarios resulted in error due to multiple requests.

          Currently,these scenarios with failed due to PDF Load are out of scope of this issue.However,we will still look into on how to handle load due to multiple request.Can you please create a Jira on this and provide us with the input of PDF threshold of PDF service(single and two services).

          Multiple requests load are handled on Production,as there are two PDF services available. However,if PDF processing of large companies(Elite staffing,SBM) are done simultaneously,then it will give server error on Production also.

          CC: Nandkumar Prabhakar Karlekar,Rakesh Roy

          Show
          ramya.tantry Ramya Tantry (Inactive) added a comment - Hi Mahendra Mungase , On Codemap(LB) environment,there is only one PDF service,whereas Pre-prod and Prod has 2 PDF services. If there are multiple requests for single PDF service,It will give server error as it cannot bear the load of multiple requests. Above mentioned scenarios resulted in error due to multiple requests. Currently,these scenarios with failed due to PDF Load are out of scope of this issue.However,we will still look into on how to handle load due to multiple request.Can you please create a Jira on this and provide us with the input of PDF threshold of PDF service(single and two services). Multiple requests load are handled on Production,as there are two PDF services available. However,if PDF processing of large companies(Elite staffing,SBM) are done simultaneously,then it will give server error on Production also. CC: Nandkumar Prabhakar Karlekar , Rakesh Roy
          Hide
          mahendra.mungase Mahendra Mungase (Inactive) added a comment -

          We have verified and marked for Preprod.

          Thanks,
          Mahendra

          Show
          mahendra.mungase Mahendra Mungase (Inactive) added a comment - We have verified and marked for Preprod. Thanks, Mahendra
          Hide
          mahendra.mungase Mahendra Mungase (Inactive) added a comment -

          We have verified this issue on Preprod and observed that it's working as expected. Hence marking ready for Production.

          Thanks,
          Mahendra

          CC- Sachin Hingole

          Show
          mahendra.mungase Mahendra Mungase (Inactive) added a comment - We have verified this issue on Preprod and observed that it's working as expected. Hence marking ready for Production. Thanks, Mahendra CC- Sachin Hingole
          Hide
          smita.pawar Smita Pawar (Inactive) added a comment -

          We have verified above mentioned issue on Karma for Hspl production company.
          Its working fine.

          Tested scenarios are as follows.
          1.Add New customization & save functionality for same.
          2.Save & Consolidated Download functionality
          3.Save & Download functionality
          4.Cancel Functionality
          5.Update operation for Customization
          6.Delete Customization
          7.Employee count for downloaded Consolidated zip file
          8.Employee count for Downloaded Zip file.

          Hence closing ticket.

          Show
          smita.pawar Smita Pawar (Inactive) added a comment - We have verified above mentioned issue on Karma for Hspl production company. Its working fine. Tested scenarios are as follows. 1.Add New customization & save functionality for same. 2.Save & Consolidated Download functionality 3.Save & Download functionality 4.Cancel Functionality 5.Update operation for Customization 6.Delete Customization 7.Employee count for downloaded Consolidated zip file 8.Employee count for Downloaded Zip file. Hence closing ticket.

            People

            Assignee:
            smita.pawar Smita Pawar (Inactive)
            Reporter:
            jennifer.leugers Jennifer Leugers
            Developer:
            Ramya Tantry (Inactive)
            QA:
            Smita Pawar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Dev Due Date:
              Code Review Date:

                Time Tracking

                Estimated:
                Original Estimate - 52h Original Estimate - 52h
                52h
                Remaining:
                Time Spent - 85h Remaining Estimate - 4h 40m
                4h 40m
                Logged:
                Time Spent - 85h Remaining Estimate - 4h 40m
                85h