Details

    • Type: New Feature
    • Status: Done
    • Priority: High
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: Enhancements - Fall
    • Labels:
      None

      Description

      DMS History: Maintaining history of all transaction tables

        Attachments

          Issue Links

            Activity

            samir Samir created issue -
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) made changes -
            Field Original Value New Value
            Sprint DMS - Sprint 6 [ 134 ]
            swapnil.pandhare Swapnil Pandhare (Inactive) made changes -
            Assignee Samir [ samir ] Nandkumar Prabhakar Karlekar [ satyap ]
            Hide
            swapnil.pandhare Swapnil Pandhare (Inactive) added a comment -

            Hi All,

            As per discussion with Samir, Moving display web page for history , business logic component removed from sprint 6. These can be taken in future.

            Thanks,
            Swapnil P.

            Show
            swapnil.pandhare Swapnil Pandhare (Inactive) added a comment - Hi All, As per discussion with Samir , Moving display web page for history , business logic component removed from sprint 6. These can be taken in future. Thanks, Swapnil P.
            swapnil.pandhare Swapnil Pandhare (Inactive) made changes -
            Link This issue relates to DMS-344 [ DMS-344 ]
            swapnil.pandhare Swapnil Pandhare (Inactive) made changes -
            Link This issue relates to DMS-347 [ DMS-347 ]
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) made changes -
            Status To Do [ 10000 ] In Progress [ 3 ]
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) logged work - 27/Dec/18 05:10 AM
            • Time Spent:
              4h
               
              <No comment>
            Hide
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) added a comment -

            We have completed Table creation and maintenance script.
            This script will automate and maintain ongoing process of maintaining history for DMS.
            Currently, we are analyzing how to maintain the history data without triggers.

            Show
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) added a comment - We have completed Table creation and maintenance script. This script will automate and maintain ongoing process of maintaining history for DMS. Currently, we are analyzing how to maintain the history data without triggers.
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) made changes -
            Remaining Estimate 0h [ 0 ]
            Time Spent 4h [ 14400 ]
            Worklog Id 152628 [ 152628 ]
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) made changes -
            Original Estimate 20h [ 72000 ]
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) made changes -
            Status In Progress [ 3 ] In Progress [ 3 ]
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) made changes -
            Status In Progress [ 3 ] Code Review [ 11801 ]
            Hide
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) added a comment -

            Hi Samir

            We have created the sp and related history tables. Please review the same

            Show
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) added a comment - Hi Samir We have created the sp and related history tables. Please review the same
            nandkumar Nandkumar Prabhakar Karlekar (Inactive) made changes -
            Assignee Nandkumar Prabhakar Karlekar [ satyap ] Samir [ samir ]
            swapnil.pandhare Swapnil Pandhare (Inactive) made changes -
            Sprint DMS - Sprint 6 [ 134 ] DMS - Sprint 7 [ 148 ]
            swapnil.pandhare Swapnil Pandhare (Inactive) made changes -
            Sprint DMS - Sprint 7 [ 148 ] DMS - Sprint 1 [ 149 ]
            samir Samir made changes -
            Sprint DMS - Sprint 1 [ 149 ]
            samir Samir made changes -
            Summary DMS History DMS transaction history
            samir Samir made changes -
            Fix Version/s Enhancements - Fall [ 10610 ]
            samir Samir made changes -
            Epic Link DMS-9 [ 69408 ]
            samir Samir made changes -
            Status Code Review [ 11801 ] To Do [ 10000 ]
            samir Samir made changes -
            Sprint DMS - Fall Sprint 4 [ 163 ]
            samir Samir made changes -
            Sprint DMS - Fall Sprint 4 [ 163 ] DMS - Fall Sprint 8 [ 167 ]
            samir Samir made changes -
            Sprint DMS - Fall Sprint 8 [ 167 ] DMS - Fall Sprint 6 [ 165 ]
            samir Samir made changes -
            Sprint DMS - Fall Sprint 6 [ 165 ] DMS - Fall Sprint 7 [ 166 ]
            samir Samir made changes -
            Assignee Samir [ samir ] Sonali Farakate [ sonali.farakate ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Status To Do [ 10000 ] In Progress [ 3 ]
            Hide
            rohan.khandave Rohan J Khandave (Inactive) added a comment -

            Hello Sonali Farakate,

            As per discussion with Samir , we can go with triggers for maintaining history of tables.

            Below tasks needs to consider into analysis of this ticket.

            1. List of tables to create history table.
            2. Procedure to create / update history table according to main table.
            3. Procedure to create triggers.
            4.Common logic to fetch history data.

            Thanks,
            RohanK

            CC – Samir , Satya , Ganesh Sadawarte , Ramya Tantry , Harshveer Singh

            Show
            rohan.khandave Rohan J Khandave (Inactive) added a comment - Hello Sonali Farakate , As per discussion with Samir , we can go with triggers for maintaining history of tables. Below tasks needs to consider into analysis of this ticket. 1. List of tables to create history table. 2. Procedure to create / update history table according to main table. 3. Procedure to create triggers. 4.Common logic to fetch history data. Thanks, RohanK CC – Samir , Satya , Ganesh Sadawarte , Ramya Tantry , Harshveer Singh
            sonali.farakate Sonali Farakate (Inactive) logged work - 11/Jul/19 06:28 AM
            • Time Spent:
              7h
               
              • Analysis of triggering in mysql
              • Discussion with Rohan and Nandu regarding implementation approach
              • Created sample trigger for insert, update and delete record of table
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Time Spent 4h [ 14400 ] 11h [ 39600 ]
            Worklog Id 187780 [ 187780 ]
            Hide
            sonali.farakate Sonali Farakate (Inactive) added a comment -

            Hi Samir,

            I have identified the total tables from the database. After discussion with Rohan J Khandave, we will finalize the exact count of the tables for which we need to create history table. 
            Once this discussion is done, I will update the ETA for this ticket.

            Thanks,
            Sonali Farakate

            Show
            sonali.farakate Sonali Farakate (Inactive) added a comment - Hi Samir , I have identified the total tables from the database. After discussion with Rohan J Khandave , we will finalize the exact count of the tables for which we need to create history table.  Once this discussion is done, I will update the ETA for this ticket. Thanks, Sonali Farakate
            sonali.farakate Sonali Farakate (Inactive) logged work - 11/Jul/19 09:24 PM
            • Time Spent:
              7h
               

              Trigger analysis

              Table identification for history table

              Discussion with Rohan regarding approch

            sonali.farakate Sonali Farakate (Inactive) made changes -
            Attachment DMS-343_HistoryTableAnalysis.xls [ 112407 ]
            Hide
            sonali.farakate Sonali Farakate (Inactive) added a comment -

            Hi Rohan J Khandave,

            Please find attached sheet for the list of tables on production for which we need to create the history table.DMS-343_HistoryTableAnalysis.xls
            Please review the same.
            I have started analysis of stored procedure to generate triggers.

            Thanks,
            Sonali Farakate 

            Show
            sonali.farakate Sonali Farakate (Inactive) added a comment - Hi Rohan J Khandave , Please find attached sheet for the list of tables on production for which we need to create the history table. DMS-343_HistoryTableAnalysis.xls Please review the same. I have started analysis of stored procedure to generate triggers. Thanks, Sonali Farakate 
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Time Spent 11h [ 39600 ] 18h [ 64800 ]
            Worklog Id 188089 [ 188089 ]
            sonali.farakate Sonali Farakate (Inactive) logged work - 14/Jul/19 09:14 PM
            • Time Spent:
              7.5h
               
              • Discussion with Rohan
              • SP writing for trigger generation
            rohan.khandave Rohan J Khandave (Inactive) made changes -
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Remaining Estimate 0h [ 0 ] 26h [ 93600 ]
            Original Estimate 20h [ 72000 ] 40h [ 144000 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Remaining Estimate 26h [ 93600 ] 18.5h [ 66600 ]
            Time Spent 18h [ 64800 ] 25.5h [ 91800 ]
            Worklog Id 188418 [ 188418 ]
            sonali.farakate Sonali Farakate (Inactive) logged work - 15/Jul/19 10:25 PM
            • Time Spent:
              7.5h
               

              Changes done in following stored procedures for History tables

              1. DMS_SP_Add_Column
              2. DMS_SP_Drop_Column
              3. DMS_SP_Modify_Column_DataType
              4. DMS_SP_Modify_Column_Rename
              5. HistoryTableCreation
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Hide
            sonali.farakate Sonali Farakate (Inactive) added a comment -

            Changes done in following stored procedures for History tables

            1. DMS_SP_Add_Column
            2. DMS_SP_Drop_Column
            3. DMS_SP_Modify_Column_DataType
            4. DMS_SP_Modify_Column_Rename
            5. HistoryTableCreation

            Please find following sheet 16July19 - DMS-343_HistoryTableAnalysis.xls for the tables which does not contain the columns 'LastUpdate_dateTime' and 'LastUpdatedby_UserID'.

            Thanks,
            Sonali Farakate

            CC : Rohan J Khandave

            Show
            sonali.farakate Sonali Farakate (Inactive) added a comment - Changes done in following stored procedures for History tables DMS_SP_Add_Column DMS_SP_Drop_Column DMS_SP_Modify_Column_DataType DMS_SP_Modify_Column_Rename HistoryTableCreation Please find following sheet  16July19 - DMS-343_HistoryTableAnalysis.xls for the tables which does not contain the columns 'LastUpdate_dateTime' and 'LastUpdatedby_UserID'. Thanks, Sonali Farakate CC : Rohan J Khandave
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Remaining Estimate 18.5h [ 66600 ] 11h [ 39600 ]
            Time Spent 25.5h [ 91800 ] 33h [ 118800 ]
            Worklog Id 188686 [ 188686 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Link This issue relates to DMS-1663 [ DMS-1663 ]
            Hide
            sonali.farakate Sonali Farakate (Inactive) added a comment -

            MOM:

            • Create history tables of the table with columns 'LastUpdate_dateTime' and 'LastUpdatedby_UserID'
            1. address
            2. codelist
            3. companysourceproductmapping
            4. dmscustomfieldmapping
            5. dmsfields
            6. document
            7. email
            8. emailaction
            9. emailplaceholder
            10. phone
            11. sentform
            12. sourceproductuser
            13. sourcesystemfieldlabel
            14. sourcesystemfields
            15. users
            • Need to add columns 'LastUpdate_dateTime' and 'LastUpdatedby_UserID' in following tables,
            1. assignment
            2. assignmentcustomattributedata
            3. attachment
            4. attachmentdetails
            5. attachmentmapping
            6. authenticationtokendetails
            7. communicationdetails
            8. company
            9. documentrouting
            10. passwordcredentials
            11. passwordorder
            12. person
            13. personcustomattributedata
            14. systemutilization
            15. useractionpermissions
            16. usercompanymapping
            17. usernamecredentials
            18. usernameorder
              We will focus on candidate level tables first for adding above mentioned columns then the remaining.
            • Need not to dump old data of main table into history table.
            • Column name consistency will be maintained while adding new columns.
            • Rushikesh Dattatray Bane will write the stored procedure for generating triggers dynamically.

            Thanks,
            Sonali Farakate.

            CC : Samir, Rohan J Khandave

            Show
            sonali.farakate Sonali Farakate (Inactive) added a comment - MOM: Create history tables of the table with columns 'LastUpdate_dateTime' and 'LastUpdatedby_UserID' address codelist companysourceproductmapping dmscustomfieldmapping dmsfields document email emailaction emailplaceholder phone sentform sourceproductuser sourcesystemfieldlabel sourcesystemfields users Need to add columns 'LastUpdate_dateTime' and 'LastUpdatedby_UserID' in following tables, assignment assignmentcustomattributedata attachment attachmentdetails attachmentmapping authenticationtokendetails communicationdetails company documentrouting passwordcredentials passwordorder person personcustomattributedata systemutilization useractionpermissions usercompanymapping usernamecredentials usernameorder We will focus on candidate level tables first for adding above mentioned columns then the remaining. Need not to dump old data of main table into history table. Column name consistency will be maintained while adding new columns. Rushikesh Dattatray Bane will write the stored procedure for generating triggers dynamically. Thanks, Sonali Farakate. CC : Samir , Rohan J Khandave
            sonali.farakate Sonali Farakate (Inactive) logged work - 17/Jul/19 06:40 AM
            • Time Spent:
              6.5h
               
              • Updates in SP HistoryTableCreation
              • Analysis for dynamic trigger generation
              • Discussion with Ramya and Rohan for dynamic trigger generation
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Remaining Estimate 11h [ 39600 ] 4.5h [ 16200 ]
            Time Spent 33h [ 118800 ] 39.5h [ 142200 ]
            Worklog Id 188962 [ 188962 ]
            sonali.farakate Sonali Farakate (Inactive) logged work - 17/Jul/19 01:54 PM - edited
            • Time Spent:
              7.5h
               

              Created History tables

              Done analysis of remaining tables

            Hide
            sonali.farakate Sonali Farakate (Inactive) added a comment - - edited

            Created following tables on local database:

            1. address_history
            2. assignment_history
            3. codelist_history
            4. company_history
            5. companysourceproductmapping_history
            6. dmscustomfieldmapping_history
            7. dmsfields_history
            8. document_history
            9. email_history
            10. emailaction_history
            11. emailplaceholder_history
            12. person_history
            13. phone_history
            14. sourceproductuser_history
            15. sourcesystemfieldlabel_history
            16. sourcesystemfields_history
            17. users_history

            Following are 13 databases where need to add columns 'LastUpdate_dateTime' and 'LastUpdatedby_UserID',

            1. Attachment
            2. attachmentdetails
            3. Attachmentmapping
            4. authenticationtokendetails
            5. CommunicationDetail
            6. documentrouting
            7. Passwordcredentials
            8. PasswordOrder
            9. systemutilization
            10. useractionpermissions
            11. usercompanymapping
            12. usernamecredentials
            13. usernameorder

            Thanks,
            Sonali Farakate.

            CC : Rohan J Khandave, Ramya Tantry

            Show
            sonali.farakate Sonali Farakate (Inactive) added a comment - - edited Created following tables on local database: address_history assignment_history codelist_history company_history companysourceproductmapping_history dmscustomfieldmapping_history dmsfields_history document_history email_history emailaction_history emailplaceholder_history person_history phone_history sourceproductuser_history sourcesystemfieldlabel_history sourcesystemfields_history users_history Following are 13 databases where need to add columns 'LastUpdate_dateTime' and 'LastUpdatedby_UserID', Attachment attachmentdetails Attachmentmapping authenticationtokendetails CommunicationDetail documentrouting Passwordcredentials PasswordOrder systemutilization useractionpermissions usercompanymapping usernamecredentials usernameorder Thanks, Sonali Farakate. CC :  Rohan J Khandave , Ramya Tantry
            sonali.farakate Sonali Farakate (Inactive) logged work - 18/Jul/19 10:42 PM
            • Time Spent:
              7.5h
               
              <No comment>
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Remaining Estimate 4.5h [ 16200 ] 0h [ 0 ]
            Time Spent 39.5h [ 142200 ] 47h [ 169200 ]
            Worklog Id 189722 [ 189722 ]
            Hide
            sonali.farakate Sonali Farakate (Inactive) added a comment - - edited

            Updated column names(for consistency) of following tables,

            Table Name Old Column Name New Column Name
            dmscustomfieldmapping UpdatedBy_UserId LastUpdatedBy_UserID
            dmscustomfieldmapping UpdatedDate LastUpdate_DateTime
            sourcesystemfieldlabel UpdatedBy_UserId LastUpdatedBy_UserID
            sourcesystemfieldlabel UpdatedDate LastUpdate_DateTime
            sourcesystemfields UpdatedBy LastUpdatedBy_UserID
            sourcesystemfields DateUpdated LastUpdate_DateTime
            sourcesystemfields CreatedBy CreatedBy_UserID
            sourcesystemfields DateCreated Created_DateTime

            For following three tables we are unable to create History table due to ERROR : "Error Code: 1118 Row size too large. The maximum row size for the used table type, not counting BLOBs, is 65535. This includes storage overhead, check the manual. You have to change some columns to TEXT or BLOBs"
            - sentform
            - assignmentcustomattributedata
            - personcustomattributedata

            To resolve this error we need to change data type of some columns in History table of it. Hence currently kept history table creation of these tables on hold.

            Thanks,
            Sonali Farakate
            CC : Samir,Rohan J Khandave

            Show
            sonali.farakate Sonali Farakate (Inactive) added a comment - - edited Updated column names(for consistency) of following tables, Table Name Old Column Name New Column Name dmscustomfieldmapping UpdatedBy_UserId LastUpdatedBy_UserID dmscustomfieldmapping UpdatedDate LastUpdate_DateTime sourcesystemfieldlabel UpdatedBy_UserId LastUpdatedBy_UserID sourcesystemfieldlabel UpdatedDate LastUpdate_DateTime sourcesystemfields UpdatedBy LastUpdatedBy_UserID sourcesystemfields DateUpdated LastUpdate_DateTime sourcesystemfields CreatedBy CreatedBy_UserID sourcesystemfields DateCreated Created_DateTime For following three tables we are unable to create History table due to ERROR : "Error Code: 1118 Row size too large. The maximum row size for the used table type, not counting BLOBs, is 65535. This includes storage overhead, check the manual. You have to change some columns to TEXT or BLOBs" - sentform - assignmentcustomattributedata - personcustomattributedata To resolve this error we need to change data type of some columns in History table of it. Hence currently kept history table creation of these tables on hold. Thanks, Sonali Farakate CC : Samir , Rohan J Khandave
            sonali.farakate Sonali Farakate (Inactive) made changes -
            sonali.farakate Sonali Farakate (Inactive) made changes -
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Time Spent 47h [ 169200 ] 54.5h [ 196200 ]
            Worklog Id 190007 [ 190007 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Worklog Id 189722 [ 189722 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Link This issue relates to DMS-1671 [ DMS-1671 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Status In Progress [ 3 ] Code Review [ 11801 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Assignee Sonali Farakate [ sonali.farakate ] Samir [ samir ]
            shashikant.mishra ShashiKant Mishra (Inactive) made changes -
            Sprint DMS - Fall Sprint 7 [ 166 ] DMS - Fall Sprint 7, DMS - Fall Sprint 8 [ 166, 167 ]
            sonali.farakate Sonali Farakate (Inactive) logged work - 22/Jul/19 06:45 AM
            • Time Spent:
              1h
               

              Code review suggestions and check ins

            sonali.farakate Sonali Farakate (Inactive) made changes -
            Time Spent 54.5h [ 196200 ] 55.5h [ 199800 ]
            Worklog Id 190478 [ 190478 ]
            sonali.farakate Sonali Farakate (Inactive) logged work - 22/Jul/19 08:57 PM - edited
            • Time Spent:
              0.5h
               

              Build issue resolve

            sonali.farakate Sonali Farakate (Inactive) made changes -
            Time Spent 55.5h [ 199800 ] 56h [ 201600 ]
            Worklog Id 190896 [ 190896 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Worklog Id 190896 [ 190896 ]
            Raj.Hawaldar Raj Hawaldar (Inactive) made changes -
            Assignee Samir [ samir ] Priya Dhamande [ priya.dhamande ]
            Raj.Hawaldar Raj Hawaldar (Inactive) made changes -
            Status Code Review [ 11801 ] In QA Testing [ 11901 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Attachment HistoryTableConsiderations.xls [ 114434 ]
            sonali.farakate Sonali Farakate (Inactive) made changes -
            Attachment HistoryTableConsiderations.xls [ 114434 ]
            Hide
            priya.dhamande Priya Dhamande (Inactive) added a comment -

            No Testing input required from QA end. So, marking jira done.

            Sachin Hingole Hrishikesh Deshpande Samir Rohan J Khandave

            Show
            priya.dhamande Priya Dhamande (Inactive) added a comment - No Testing input required from QA end. So, marking jira done. Sachin Hingole Hrishikesh Deshpande Samir Rohan J Khandave
            priya.dhamande Priya Dhamande (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status In QA Testing [ 11901 ] Done [ 10001 ]
            Transition Time In Source Status Execution Times
            Nandkumar Prabhakar Karlekar (Inactive) made transition -
            In Progress In Progress
            8d 6h 38m 1
            Samir made transition -
            Code Review To Do
            116d 19h 28m 1
            Sonali Farakate (Inactive) made transition -
            To Do In Progress
            77d 17h 3m 2
            Sonali Farakate (Inactive) made transition -
            In Progress Code Review
            11d 45m 2
            Raj Hawaldar (Inactive) made transition -
            Code Review In QA Testing
            3d 4h 23m 1
            Priya Dhamande (Inactive) made transition -
            In QA Testing Done
            3d 22h 22m 1

              People

              Assignee:
              priya.dhamande Priya Dhamande (Inactive)
              Reporter:
              samir Samir
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 56h Original Estimate - 56h
                  56h
                  Remaining:
                  Time Spent - 70h Remaining Estimate - 2h
                  2h
                  Logged:
                  Time Spent - 70h Remaining Estimate - 2h
                  70h