Home Forums Kamanja Forums Features & Releases Running Kamanja on 2 nodes

This topic contains 5 replies, has 5 voices, and was last updated by  Archived_User64 1 year, 6 months ago.

  • Author
    Posts
  • #13482 Reply

    Archived_User19
    Participant

    Hello,

    we did a test run for COPS models with our dataGenerationTool, the run was for 7 continuous days.
    we used Kamanja-1.1.8 , and it was installed on 2 nodes .
    however , after the run finished we discovered that one of the nodes was never utilized. any ideas on how to fix or find out what the issue is ?

    Regards,
    Haitham

  • #13483 Reply

    Archived_User7
    Participant

    Was it similar data generated incrementally over the number of days or each message was unique?

  • #13484 Reply

    Archived_User79
    Participant

    It depends on number of partitions that were used for kafka input topic.
    Make sure you have more than one partition and also the make sure test data has more than one for user id.

    Thanks,
    Sridhar

  • #13485 Reply

    Archived_User28
    Participant

    Did you partition the input queue?

  • #13486 Reply

    Archived_User19
    Participant

    inside the CreateQueues.sh file i found this:
    …..
    $KAFKA_HOME/bin/kafka-topics.sh –create –zookeeper 172.30.2.55:2181 –replication-factor 1 –partitions 6 –topic c_input
    $KAFKA_HOME/bin/kafka-topics.sh –create –zookeeper 172.30.2.55:2181 –replication-factor 1 –partitions 6 –topic c_output
    …..

    i think it means it has 6 partitions.
    could it be a configuration issue ? where should i look for such thing?

  • #13487 Reply

    Archived_User64
    Participant

    Haitham,

    Make sure that you run CreatQueue.sh script before starting the cluster .

    Sent from my Windows Phone

Reply To: Running Kamanja on 2 nodes
Your information: