Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-5864

Starting Standalone on IDE produces a lot of error message from Audit

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 3.4.0
    • Fix Version/s: 4.0.0
    • Component/s: Kafka
    • Labels:
      None
    • Rank:
      1|hzzcd3:

      Description

      Since audit.enabled is set true by default, running standalone on IDE produces a lot of error message (because Kafka is not started). Need a better way on handling this case.

      RROR [Endure-Service-:c.c.c.d.a.KafkaAuditPublisher@74] - Got exception publishing audit message AuditMessage{version=1, time=1461966592920, entityId=artifact:system.transform-plugins.1.3.0-SNAPSHOT, user='.cdap', type=METADATA_CHANGE, payload=MetadataPayload{previous={SYSTEM=Metadata{properties={plugin-version:CSVParser:transform=CSVParser:1.3.0-SNAPSHOT, plugin:Hasher:transform=Hasher:transform, plugin-version:StreamFormatter:transform=StreamFormatter:1.3.0-SNAPSHOT, plugin-version:JSONParser:transform=JSONParser:1.3.0-SNAPSHOT, plugin:StreamFormatter:transform=StreamFormatter:transform, plugin-version:Decompressor:transform=Decompressor:1.3.0-SNAPSHOT, plugin:Encoder:transform=Encoder:transform, plugin:CSVFormatter:transform=CSVFormatter:transform, plugin:JSONFormatter:transform=JSONFormatter:transform, plugin-version:Encoder:transform=Encoder:1.3.0-SNAPSHOT, plugin-version:Compressor:transform=Compressor:1.3.0-SNAPSHOT, plugin:JSONParser:transform=JSONParser:transform, plugin:CloneRecord:transform=CloneRecord:transform, plugin-version:CSVFormatter:transform=CSVFormatter:1.3.0-SNAPSHOT, plugin-version:JSONFormatter:transform=JSONFormatter:1.3.0-SNAPSHOT, plugin:CSVParser:transform=CSVParser:transform, plugin-version:Decoder:transform=Decoder:1.3.0-SNAPSHOT, plugin:Decoder:transform=Decoder:transform, plugin-version:CloneRecord:transform=CloneRecord:1.3.0-SNAPSHOT, plugin:Compressor:transform=Compressor:transform, plugin:Decompressor:transform=Decompressor:transform, plugin-version:Hasher:transform=Hasher:1.3.0-SNAPSHOT}, tags=[]}}, additions={SYSTEM=Metadata{properties={}, tags=[transform-plugins]}}, deletions={SYSTEM=Metadata{properties={}, tags=[]}}} AuditPayload{}}. Exception:
      java.util.concurrent.ExecutionException: java.lang.IllegalStateException: No kafka producer available.
      	at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294) ~[guava-13.0.1.jar:na]
      	at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:281) ~[guava-13.0.1.jar:na]
      	at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) ~[guava-13.0.1.jar:na]
      	at co.cask.cdap.data2.audit.KafkaAuditPublisher.publish(KafkaAuditPublisher.java:72) ~[classes/:na]
      	at co.cask.cdap.data2.audit.AuditPublishers.publishAudit(AuditPublishers.java:112) [classes/:na]
      	at co.cask.cdap.data2.metadata.store.DefaultMetadataStore.publishAudit(DefaultMetadataStore.java:510) [classes/:na]
      	at co.cask.cdap.data2.metadata.store.DefaultMetadataStore.publish(DefaultMetadataStore.java:502) [classes/:na]
      	at co.cask.cdap.data2.metadata.store.DefaultMetadataStore.addTags(DefaultMetadataStore.java:168) [classes/:na]
      	at co.cask.cdap.data2.metadata.system.AbstractSystemMetadataWriter.write(AbstractSystemMetadataWriter.java:103) [classes/:na]
      	at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.writeSystemMetadata(ArtifactRepository.java:893) [classes/:na]
      	at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addArtifact(ArtifactRepository.java:486) [classes/:na]
      	at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addSystemArtifact(ArtifactRepository.java:707) [classes/:na]
      	at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addSystemArtifacts(ArtifactRepository.java:686) [classes/:na]
      	at co.cask.cdap.internal.app.runtime.artifact.SystemArtifactLoader$1$1.doStart(SystemArtifactLoader.java:48) [classes/:na]
      	at com.google.common.util.concurrent.AbstractService.start(AbstractService.java:170) [guava-13.0.1.jar:na]
      	at com.google.common.util.concurrent.AbstractService.startAndWait(AbstractService.java:220) [guava-13.0.1.jar:na]
      	at co.cask.cdap.common.service.RetryOnStartFailureService$1.run(RetryOnStartFailureService.java:62) [classes/:na]
      Caused by: java.lang.IllegalStateException: No kafka producer available.
      	at org.apache.twill.internal.kafka.client.SimpleKafkaPublisher$SimplePreparer.send(SimpleKafkaPublisher.java:120) ~[twill-core-0.7.0-incubating.jar:0.7.0-incubating]
      	... 14 common frames omitted
      2016-04-29 15:03:01,567 - ERROR [New I/O worker #57:c.c.c.g.r.h.OutboundHandler@72] - Got exception [id: 0x3a3f32b9, /127.0.0.1:50440 :> localhost/127.0.0.1:63602]
      java.nio.channels.ClosedChannelException: null
      	at org.jboss.netty.channel.socket.nio.AbstractNioWorker.cleanUpWriteBuffer(AbstractNioWorker.java:434) ~[netty-3.6.6.Final.jar:na]
      	at org.jboss.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:374) ~[netty-3.6.6.Final.jar:na]
      	at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:93) ~[netty-3.6.6.Final.jar:na]
      	at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109) ~[netty-3.6.6.Final.jar:na]
      	at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312) ~[netty-3.6.6.Final.jar:na]
      	at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90) ~[netty-3.6.6.Final.jar:na]
      	at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) ~[netty-3.6.6.Final.jar:na]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_80]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_80]
      	at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80]
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gokul Gokul Gunasekaran
                Reporter:
                edwin Edwin Elia
              • Votes:
                1 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: