Uploaded image for project: 'Workterra Development '
  1. Workterra Development
  2. WD-140

Workterra Import File - Encoding Type - UTF-8

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Medium
    • Resolution: Bug Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
    • Company:
      All Clients/Multiple Clients
    • Categories:
      Import

      Description

      From Van Nguyen

      Hello team,

      BioRad is the 2nd client that have requested that we process the import files with encoding type UTF-8. MRTX was the 1st one that requested this in November.

      Company Template Name: _Employee Data New Hires
      File date: 3/16/2018
      Filename: EmployeeCensus.txt

      Employee: Marcella Gordon
      Incorrect Address imported into Workterra: 12 O’Neil Ct.
      Correct Address that should've been imported into Workterra: 12 O'Neil Ct.

      When I manually opened the file using the TextPad application, I saw the address with the invalid special characters. 12 O’Neil Ct.

      When I manually opened the file using the NotePad application, I saw the address without the invalid special characters, 12 O'Neil Ct.

      I've requested for the client to temporarily remove the special characters for now, but they refuse to do that. They want us to be able to process the import files using encoding type UTF-8.

      Note from Bio-Rad's IT department:

      From: Balakrishna Reddy <balakrishna_reddy@bio-rad.com>
      Date: Mon, Mar 19, 2018 at 12:10 PM
      Subject: Re: FW: Bio-Rad - MHN - failure - special character in address
      To: Julie Bates <julie_bates@bio-rad.com>
      Cc: Maricel Chesney Edpao <maricel_chesney-edpao@bio-rad.com>, Maria Fonseca <maria_fonseca@bio-rad.com>
      Hi Julie

      I am not sure how WorkTerra opened the file and which tool they are using to open the file from fTP server.

      Workterra needs to open the file in a tool which supports UTF-8 format.. If not, you will see the data as shown below. We use Notepad++

      Also we don't have any insights on how workterra program is designed to read the data from FTP server side. We had the same issue from another vendor and they have changed their Decryption logic to read the file as UTF -8 and it resolved their issue

       

      Satya,Vinayak Kulkarni,Prashant Samal

        Attachments

        1. AffectedFiles.txt
          0.4 kB
        2. Analysis - WD_140.doc
          17 kB
        3. WD-140.png
          WD-140.png
          42 kB
        4. WT_Sprint-46_Wd_140_Sanjanajadhav.xls
          19 kB

          Activity

          Hide
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment -

          Hi,

          Please refer attached test cases:
          WT_Sprint-46_Wd_140_Sanjanajadhav.xls

          Thanks,
          Sanjana Jadhav
          CC: Prasad Pise Rakesh Roy Sachin Hingole

          Show
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment - Hi, Please refer attached test cases: WT_Sprint-46_Wd_140_Sanjanajadhav.xls Thanks, Sanjana Jadhav CC: Prasad Pise Rakesh Roy Sachin Hingole
          Hide
          suraj.sokasane Suraj Sokasane (Inactive) added a comment -

          Attached the analysis document : Analysis - WD_140.doc

          Show
          suraj.sokasane Suraj Sokasane (Inactive) added a comment - Attached the analysis document :  Analysis - WD_140.doc
          Hide
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment -

          Hi Suraj Sokasane

          Verified on LB.
          For some UTF-8 character (such as Ɏ,ʂ, ɱ,ʘ) file imported successfully but ?? shown on UI instead of UTF-8 character .
          PFA,

          Thanks,
          Sanjana Jadhav

          CC: Prasad Pise Sachin Hingole Rakesh Roy Hrishikesh Deshpande

          Show
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment - Hi Suraj Sokasane Verified on LB. For some UTF-8 character (such as Ɏ,ʂ, ɱ,ʘ) file imported successfully but ?? shown on UI instead of UTF-8 character . PFA, Thanks, Sanjana Jadhav CC: Prasad Pise Sachin Hingole Rakesh Roy Hrishikesh Deshpande
          Hide
          suraj.sokasane Suraj Sokasane (Inactive) added a comment -

          Hi Sanjana Jadhav,

          Those are characters from other languages. For example, Ɏ is used in Lubuagan Kalinga language. As part of this enhancement, we supported the English UTF-8 char set. 

          Show
          suraj.sokasane Suraj Sokasane (Inactive) added a comment - Hi Sanjana Jadhav , Those are characters from other languages. For example, Ɏ is used in Lubuagan Kalinga language. As part of this enhancement, we supported the English UTF-8 char set. 
          Hide
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment -

          Verified on LB for English UTF-8 char set.
          Verified test cases attached.Works properly.
          Ready for Pre production.

          Thanks,
          Sanjana Jadhav

          CC: Prasad Pise Sachin Hingole Rakesh Roy Hrishikesh Deshpande

          Show
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment - Verified on LB for English UTF-8 char set. Verified test cases attached.Works properly. Ready for Pre production. Thanks, Sanjana Jadhav CC: Prasad Pise Sachin Hingole Rakesh Roy Hrishikesh Deshpande
          Hide
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment -

          Verified on Pre production for English UTF-8 char set.
          Verified test cases attached.Works properly.
          Ready for Production.

          Thanks,
          Sanjana Jadhav

          CC: Prasad Pise Sachin Hingole Rakesh Roy

          Show
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment - Verified on Pre production for English UTF-8 char set. Verified test cases attached.Works properly. Ready for Production. Thanks, Sanjana Jadhav CC: Prasad Pise Sachin Hingole Rakesh Roy
          Hide
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment -

          Verified on production.
          Company: COSB For HSPL
          Verified all attached test cases. Working as expected.
          Hence closing this issue.

          Thanks,
          Sanjana Jadhav

          CC: Prasad Pise Sachin Hingole Rakesh Roy

          Show
          sanjana.jadhav Sanjana Jadhav (Inactive) added a comment - Verified on production. Company: COSB For HSPL Verified all attached test cases. Working as expected. Hence closing this issue. Thanks, Sanjana Jadhav CC: Prasad Pise Sachin Hingole Rakesh Roy

            People

            Assignee:
            sanjana.jadhav Sanjana Jadhav (Inactive)
            Reporter:
            Ganesh.sadawarte Ganesh Sadawarte (Inactive)
            Developer:
            Suraj Sokasane (Inactive)
            QA:
            Sanjana Jadhav (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Dev Due Date:
              Code Review Date:

                Time Tracking

                Estimated:
                Original Estimate - 0h
                0h
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 12.7h
                12.7h