json to json conversion by ExecuteScript processor

Question

I have following json data and i want to convert data in expected result by ExecuteScript nifi processor

{
"time": "2017-01-01T01:14:55+00:00",
"any": {
"nested": "data"
}
}

expected Result

{
"time": 1483233295,
"any": {
"nested": "data"
}
}

I am using following groovy code but getting some error please help to find the solution

var flowFile = session.get();
if (flowFile !== null) {

var StreamCallback = Java.type("org.apache.nifi.processor.io.StreamCallback");
var IOUtils = Java.type("org.apache.commons.io.IOUtils");
var StandardCharsets = Java.type("java.nio.charset.StandardCharsets");

flowFile = session.write(flowFile, new 
        StreamCallback(function(inputStream, outputStream) {

var inputJSON = IOUtils.toString(inputStream,StandardCharsets.UTF_8);
var contentObj = JSON.parse(inputJSON);

contentObj.time = flowFile.getAttribute("timestamp");


outputStream.write(JSON.stringify(contentObj).getBytes(StandardCharsets.UTF_8));
}));

session.transfer(flowFile, REL_SUCCESS);
}

getting error

org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:
/home/jdoodle.groovy: 8: unable to resolve class StreamCallback
 @ line 8, column 36.
   flowFile = session.write(flowFile, new 
                                      ^

1 error

Also, it looks like all the JavaScript examples here: community.cloudera.com/t5/Community-Articles/… — tim_yates
– tim_yates, Commented Jul 1, 2022 at 16:14

daggett · Accepted Answer · 2022-09-01 16:33:29Z

3

use ExecuteGroovyScript processor (it's optimized for groovy lang) with this kind of code:

import groovy.json.JsonSlurper
import groovy.json.JsonBuilder

def flowFile = session.get()
if (!flowFile) return

flowFile.write{rawIn, rawOut->
    def json = rawIn.withReader("UTF-8"){ r-> new JsonSlurper().parse(r) }
    json.time = Date.parse("yyyy-MM-dd'T'HH:mm:ssX", json.time).getTime()/1000
    rawOut.withWriter("UTF-8"){ w-> new JsonBuilder(json).writeTo(w) }
}

REL_SUCCESS << flowFile

this code converts format of the field time with Date format to unix epoch time inside json content of flowfile.

edited Sep 1, 2022 at 16:33

answered Jul 3, 2022 at 9:57

daggett

29k3 gold badges52 silver badges61 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Neeraj Over a year ago

Hi daggett Thanks for your response

Neeraj Over a year ago

getting some error : ERROR [Timer-Driven Process Thread-8] o.a.n.p.groovyx.ExecuteGroovyScript ExecuteGroovyScript[id=c4849b42-0181-1000-9e76-01b5367ca62a] groovy.lang.MissingMethodException: No signature of method: Scriptffffffffd89aa9e8.var() is applicable for argument types: (org.apache.nifi.processors.groovyx.flow.GroovySessionFile)

daggett Over a year ago

Sorry, should be def instead of var. Copy-paste issue.

Neeraj Over a year ago

Soory Daggett its work for me

Collectives™ on Stack Overflow

json to json conversion by ExecuteScript processor

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related