Home Forums Kamanja Forums Features & Releases File Adaptor

This topic contains 6 replies, has 5 voices, and was last updated by  Archived_User19 1 year, 6 months ago.

  • Author
    Posts
  • #13249 Reply

    Archived_User1
    Participant

    Even after specifying the file format as below.

     
              "Name": "Name",
              "TypeString": "Output",
              "DataFormat": "CSV",
              "ClassName": "com.ligadata.OutputAdapters.FileProducer$",
              "JarName": "filesimpleinputoutputadapters_2.10-1.0.jar",
              "DependencyJars": [
            "metrics-core-2.2.0.jar",
            "zkclient-0.3.jar",
            "kamanjabase_2.10-1.0.jar"
    ],
              "AdapterSpecificCfg": {
                "CompressionString": "",
                "Files": "/xxxxx"
    The output is written in a CSV file in a JSON format.
    {"ModelsResult":[{"ModelName":"System.xxxxxxx","ModelVersion":"1000005000004","uniqKey":"{\"Version\":1,\"Type\":\"File\",\"Name\":\"File\"}","uniqVal":"{\"Version\":1,\"FileFullPath\":\"/xxxxxxx\",\"Offset\":0}","xformedMsgCntr":1,"totalXformedMsgs":1,"output":[{"Name":"TotalBalances","Value":"000000.00"},
     

    Can we write the output as field names as header and values below that.

  • #13250 Reply

    Archived_User1
    Participant

    Team
    Any response on this will highly appreaciated.Currently we are stuck on one of the use case where we have to manualy format the output to make it a CSV where the output is close to 2000 records.

    • #13252 Reply

      Archived_User7
      Participant

      I will make sure this gets addressed at the engineering team meeting this morning (in about an hour).

      • #13253 Reply

        Archived_User79
        Participant

        Is this the issue that William, Amit, Koshy and myself discussed in the meeting? If so, I believe Amit and Koshy explained this to Arun. Is there still an outstanding question?

  • #13251 Reply

    Archived_User42
    Participant

    Sridhar/Raghu, could the output adapter you are building help?

  • #13255 Reply

    Archived_User42
    Participant

    can we get the details of the discussion in the forum for others to benefit from?

    • #13257 Reply

      Archived_User19
      Participant

      The file output adapter will always produce JSON. You will need to parse it separately if you need a plain CSV.

      I presume you want to use it for further ETL – you can even use JSON sources if that suits the case.

      thanks

Reply To: File Adaptor
Your information: