PH52389: KAFKA ADAPTER NEEDS SUPPORT FOR STRICT CONVERSION FROM AVRO TO JSON WHICH PRESERVES UNION TYPES IN THE SCHEMA

APAR status

• Closed as program error.

Error description

• The Kafka Adapter needs support for strict conversion from Avro
  to JSON which preserves union types in the schema, so that the
  produced JSON is compliant with the schema and can be converted
  back to Avro.
  

Local fix

• ITXCQ - ITX00061598
  LV / LV
  Circumvention: None
  

Problem summary

• Users Affected:
  IBM Transformation Extender users using the Apache Kafka
  adapter.
  
  Problem Description:
  The adapter needed to support strict conversion from Avro to
  JSON which preserves union types in the schema, so that the
  produced JSON is compliant with the schema and can be converted
  back to Avro.
  Additionally, it was requested that the adapter provide the
  ability to use custom encoder and decoder classes in addition
  to those coming with the official Apache Avro library.
  
  Platforms Affected:
  All
  

Problem conclusion

• Command -AJCM STRICT was added to the adapter to request strict
  conversion from Avro to JSON which preserves union types.
  Also -AJECN class_name and -JADCN class_name commands were added
  to specify custom Avro to JSON encoder class name, and custom
  JSON to Avro decoder class name for.
  For example, when -JADCN org.apache.avro.io.ExtendedJsonDecoder
  is specified and the avro jar provided with the adapter is
  replaced with community provided avro-1.9.0.12p.jar, then it is
  possible to produce Avro message on the topic even with the
  non-strict input JSON which ignores unions. Note that
  avro-1.9.0.12p.jar is compatible with
  kafka-avro-serializer-6.0.0 so 6.0.0 serializer JARs need to be
  combined with it.
  
  Applies to:
  10.1.1.1, 10.1.2.0
  
  Fixed in the next service packs and releases.
  
  To obtain the fix for this APAR:
  
  To see if the next service pack or product release is available,
  check the IBM Transformation Extender Release Notes page:
  https://www.ibm.com/support/docview.wss?uid=swg27008337
  
  If the service pack or product release is available, download it
  from Fix Central:
  http://www.ibm.com/support/fixcentral/
  
  If the service pack or product release is not available and you
  require the APAR fix immediately, request a Limited Availability
  Interim Fix (LAIF) by opening a case:
  https://www.ibm.com/mysupport/
  
  Prior to version 9.0.0, IBM Transformation Extender was called
  IBM WebSphere Transformation Extender.
  

Temporary fix

Comments

APAR Information

• APAR is sysrouted FROM one or more of the following:

• APAR is sysrouted TO one or more of the following:

Fix information

• Fixed component name

  ITX

• Fixed component ID

  5724Q2300

Applicable component levels