-
Type:
Enhancement
-
Status: Closed
-
Priority:
Critical
-
Resolution: Done
-
Component/s: Performance
-
Labels:None
-
Module:Platform - Performance
-
Reported by:Support
-
Item State:Production Complete - Closed
-
Issue Importance:Must Have
Observation: During export of any template, entire text of generated file is read into system memory and written back on file along with header test. This at times creates a scenario where sufficient virtual space is not available in system memory for allocation of entire file text resulting in out of memory exception. To resolve this, we can modify this logic to read the file contents in chunks / line by line so that large memory space is not required for allocation at a time.
| Code Review Date | 27/Sep/2016 | |
| Code Reviewed By | Vijayendra Shinde [ 11901 ] | |
| Dev Due Date | 26/Sep/2016 | 28/Sep/2016 |
| Attachment | Header_Change_Scenarios_Export.xls [ 27866 ] |
| Attachment | Header_Change_Scenarios_Export.xls [ 27866 ] |
| Attachment | Header_Change_Scenarios_Export.xls [ 28047 ] |
| Item State | Parent values: Development(10200)Level 1 values: In Progress(10206) | Parent values: Development(10200)Level 1 values: Ready for Local Testing(10209) |
Affected Files:
App/BusinessLogic/ImportExportDTS/ExecuteExportDTS.vb
App/BusinessLogic/ImportExportDTS/ACAExportProcessRowwise.vb
App/BusinessLogic/ImportExportDTS/CommonExportRoutines.vb
App/BusinessLogic/ImportExportDTS/DemographicExportRowwise.vb
App/BusinessLogic/ImportExportDTS/ExportProcess.vb
App/BusinessLogic/ImportExportDTS/ExportProcessRowwise.vb
| Code Reviewed By | Vijayendra Shinde [ 11901 ] | Vinalyak Kulkarni [ 12100 ] |
| QA | Aniruddha Dev [ aniruddha.dev ] |
Khandu Kshirsagar (Inactive)
made changes -
| Item State | Parent values: Development(10200)Level 1 values: Ready for Local Testing(10209) | Parent values: LB QA(10201)Level 1 values: LB Deployed(11600) |
| Assignee | Saurabh Sablaka [ saurabh.sablaka ] | Aniruddha Dev [ aniruddha.dev ] |
| Assignee | Aniruddha Dev [ aniruddha.dev ] | Priya Dhamande [ priya.dhamande ] |
| Item State | Parent values: LB QA(10201)Level 1 values: LB Deployed(11600) | Parent values: LB QA(10201)Level 1 values: In Testing(10210) |
The testing for this jira is in progress. Till now below scenarios covered:
Row wise and Column wise Company level with Header and Without Header
1. Fixed Length
2. XLS
3. Tab
4. Pipe / Other Delimiter
5. CSV
6. Template Record Count count
Observations:
1. For Template Record count: It is appearing for only Row wise Template. No columnwise template is displaying the value for Record count.
2. When Row wise | Fixed length Template exported | extra space is observed when Total Record count is mapped.
3. Similarly, for Other delimiter and Tab delimiter extra pipe was observed when Total count is mapped at end.
4. When mapped at start, for first row it appeared as expected but for other rows comma is observed.
ex: , John Johny 123456987
Will be continuing remaining scenarios tomorrow.
| Attachment | Export_Header_Change_ScenariosCovered_QA.xls [ 28808 ] |
The Testing of Header and Template Record Count is completed on LB for ASML company.
1. The enhancement is checked at company and Global level for Row wise and Column wise.
2. This also includes testing these templates with file format ANSI file Fixed Length, XLS, Tab , Pipe / Other Delimiter, CSV and XML
3. PGP encryption will be tested on Stage as this functionality is not working on LB.
4. The exported file is also checked for zip protection.
Please find the attachment of scenarios covered during testing along with their status.
| Item State | Parent values: LB QA(10201)Level 1 values: In Testing(10210) | Parent values: LB QA(10201)Level 1 values: Ready for Stage(10213) |
| Status | New Request [ 10029 ] | Pending for Approval [ 10002 ] |
| Status | Pending for Approval [ 10002 ] | Approved for Development [ 10003 ] |
| Status | Approved for Development [ 10003 ] | In Development [ 10007 ] |
| Status | In Development [ 10007 ] | Local Testing [ 10200 ] |
| Status | Local Testing [ 10200 ] | Pending for Stage Approval [ 10300 ] |
Khandu Kshirsagar (Inactive)
made changes -
| Item State | Parent values: LB QA(10201)Level 1 values: Ready for Stage(10213) | Parent values: Stage QA(10202)Level 1 values: Stage Deployed(11602) |
| Item State | Parent values: Stage QA(10202)Level 1 values: Stage Deployed(11602) | Parent values: Stage QA(10202)Level 1 values: In Testing(10214) |
| Status | Pending for Stage Approval [ 10300 ] | Approved for Stage [ 10030 ] |
| Status | Approved for Stage [ 10030 ] | Stage Testing [ 10201 ] |
The Testing of Header and Template Record Count is completed on Stage for ASML company. Scenarios covered:
1. Row wise and Column wise [Fixed Length, CSV, XLS, Tab Delimiter and Other Delimiter] with Header Trailer with Template Record Count
2. Row wise and Column wise [Fixed Length, CSV, XLS, Tab Delimiter and Other Delimiter] without Header Trailer along with Template Record Count
3. Zip file by manual export
4. PGP file with manual export
| Attachment | Export_Header_Change_ScenariosCovered_QA.xls [ 29802 ] |
The Testing of enhancement for optimization Write Header Trailer records is completed on Stage.
Scenarios covered are attached with the jira.
The enhancement is checked at Company and Global level for Row wise and Company wise templates. The file type exported was CSV, XLS, Tab delimiter, Other delimiter and Fixed Length.
The PGP and zip format files are also exported on FTP, SFTP and Manual export.
As all scenarios worked well, moving jira on production.
| Item State | Parent values: Stage QA(10202)Level 1 values: In Testing(10214) | Parent values: Stage QA(10202)Level 1 values: Ready for Production(10217) |
| Status | Stage Testing [ 10201 ] | Pending for Production Approval [ 10301 ] |
| Status | Pending for Production Approval [ 10301 ] | Approved for production [ 10034 ] |
| Remaining Estimate | 6h [ 21600 ] | |
| Original Estimate | 6h [ 21600 ] |
| Item State | Parent values: Stage QA(10202)Level 1 values: Ready for Production(10217) | Parent values: Production QA(10203)Level 1 values: Production Deployed(10221) |
-
- Time Spent:
- 1h
-
Integration test for basic template functionality
-
- Time Spent:
- 0.5h
-
Production - code check in
| Remaining Estimate | 6h [ 21600 ] | 5.5h [ 19800 ] |
| Time Spent | 0.5h [ 1800 ] | |
| Worklog Id | 11233 [ 11233 ] |
| Status | Approved for production [ 10034 ] | Production Testing [ 10202 ] |
| Item State | Parent values: Production QA(10203)Level 1 values: Production Deployed(10221) | Parent values: Production QA(10203)Level 1 values: In Testing(10218) |
Verified Header Trailer on Demographic Rowise , Payroll Columnwise , Payroll Rowise , ANSI 834 and Group Level Templates with Scheduler on production LHP for HSPL company .
Working as expected on Production
| Resolution | Fixed [ 1 ] | |
| Status | Production Testing [ 10202 ] | Production Complete [ 10028 ] |
| Item State | Parent values: Production QA(10203)Level 1 values: In Testing(10218) | Parent values: Production Complete(10222)Level 1 values: Closed(10223) |
| Status | Production Complete [ 10028 ] | Closed [ 6 ] |
| Remaining Estimate | 5.5h [ 19800 ] | 4h [ 14400 ] |
| Time Spent | 0.5h [ 1800 ] | 2h [ 7200 ] |
| Worklog Id | 11329 [ 11329 ] |
| Remaining Estimate | 4h [ 14400 ] | 3h [ 10800 ] |
| Time Spent | 2h [ 7200 ] | 3h [ 10800 ] |
| Worklog Id | 11414 [ 11414 ] |
| Remaining Estimate | 3h [ 10800 ] | 1.5h [ 5400 ] |
| Time Spent | 3h [ 10800 ] | 4.5h [ 16200 ] |
| Worklog Id | 13651 [ 13651 ] |
| Remaining Estimate | 1.5h [ 5400 ] | 3h [ 10800 ] |
| Time Spent | 4.5h [ 16200 ] | 3h [ 10800 ] |
| Worklog Id | 13651 [ 13651 ] | |
| Worklog Time Spent | 1.5h [ 5400 ] |
| Transition | Time In Source Status | Execution Times |
|---|
|
12d 23h 28m | 1 |
|
3s | 1 |
|
2s | 1 |
|
3s | 1 |
|
4s | 1 |
|
10d 17h 20m | 1 |
|
2s | 1 |
|
3d 7h 2m | 1 |
|
2s | 1 |
|
43d 1h 35m | 1 |
|
3m 25s | 1 |
|
19s | 1 |
Affected Files:
App/BusinessLogic/ImportExportDTS/ACAExportProcessRowwise.vb
App/BusinessLogic/ImportExportDTS/DemographicExportRowwise.vb
App/BusinessLogic/ImportExportDTS/CommonExportRoutines.vb
App/BusinessLogic/ImportExportDTS/ExecuteExportDTS.vb
App/BusinessLogic/ImportExportDTS/ExportProcess.vb
App/BusinessLogic/ImportExportDTS/ExportProcessRowwise.vb