Home Forums Kamanja Forums Problems & Solutions My ClusterCfgMetadataAPIConfig.properties

This topic contains 3 replies, has 2 voices, and was last updated by  Archived_User7 1 year, 8 months ago.

  • Author
    Posts
  • #13511 Reply

    Archived_User64
    Participant

    Hi,
    I am on step 2 of the Kamanja Cluster Installation (I’m looking at the test file in my Kamanja/ClusterInstall directory. Here’s what my ClusterCfgMetadataAPIConfig.properties file looks like.

    NODEID={NodeId}
    MetadataDataStore={"StoreType": "hbase","SchemaName": "kamanja","Location": "localhost", "authentication":"kerberos","regionserver_principal":"hbase/_HO...@INTRANET.LIGADATA.COM","master_principal":"hbase/_HO...@INTRANET.LIGADATA.COM","principal":"liga...@INTRANET.LIGADATA.COM","keytab":"/Users/alisonapel/Downloads/Kamanja/config/ligadata.keytab"}
    ROOT_DIR=/Users/alisonapel/Downloads/Kamanja
    GIT_ROOT=/Users/alisonapel/Downloads/Kamanja
    JAR_TARGET_DIR=/Users/alisonapel/Downloads/Kamanja/lib/application
    SCALA_HOME=/Users/alisonapel/Downloads/scala-2.10.4
    JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8_65.jdk/Contents/Home
    MANIFEST_PATH=/Users/alisonapel/Downloads/Kamanja/config/manifest.mf
    CLASSPATH=/Users/alisonapel/Downloads/Kamanja/lib/system/metadata_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/basefunctions_2.10-0.1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/messagedef_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/methodextractor_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/pmmlcompiler_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/kamanjabase_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/kvbase_2.10-0.1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/bootstrap_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/joda-time-2.8.2.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/joda-convert-1.6.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/basetypes_2.10-0.1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/pmmludfs_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/pmmlruntime_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/json4s-native_2.10-3.2.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/json4s-core_2.10-3.2.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/json4s-ast_2.10-3.2.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/jackson-databind-2.3.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/jackson-annotations-2.3.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/json4s-jackson_2.10-3.2.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/jackson-core-2.3.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/log4j-core-2.4.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/log4j-api-2.4.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/guava-16.0.1.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/exceptions_2.10-1.0.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/scala-reflect-2.10.4.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/scala-library-2.10.4.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/jsr305-1.3.9.jar:/Users/alisonapel/Downloads/Kamanja/lib/system/datadelimiters_2.10-1.0.jar
    NOTIFY_ENGINE=YES
    ZNODE_PATH=/kamanja
    API_LEADER_SELECTION_ZK_NODE=/kamanja
    ZOOKEEPER_CONNECT_STRING=localhost:2181
    COMPILER_WORK_DIR=/Users/alisonapel/Downloads/Kamanja/workingdir
    SERVICE_HOST={HostName}
    SERVICE_PORT=8081
    MODEL_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config
     COMPILER_WORK_DIR=/Users/alisonapel/Downloads/Kamanja/workingdir
    SERVICE_HOST={HostName}
    SERVICE_PORT=8081
    MODEL_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config
    TYPE_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config
    FUNCTION_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config
    CONCEPT_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config
    MESSAGE_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config
    CONTAINER_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config
    CONFIG_FILES_DIR=/Users/alisonapel/Downloads/Kamanja/config
    MODEL_EXEC_LOG=false
    JarPaths=/Users/alisonapel/Downloads/Kamanja/lib/system,/Users/alisonapel/Downloads/Kamanja/lib/application
    SECURITY_IMPL_JAR=/Users/alisonapel/Downloads/Kamanja/lib/system/simpleapacheshiroadapter_2.10-1.0.jar
    SECURITY_IMPL_CLASS=com.ligadata.Security.SimpleApacheShiroAdapter
    AUDIT_IMPL_JAR=/Users/alisonapel/Downloads/Kamanja/lib/system/auditadapters_2.10-1.0.jar
    AUDIT_IMPL_CLASS=com.ligadata.audit.adapters.AuditCassandraAdapter
    DO_AUDIT=NO
    DO_AUTH=NO
    SSL_CERTIFICATE=/Users/alisonapel/Downloads/Kamanja/config/keystore.jks
    SSL_PASSWD=keystore

    My questions are:

    Substep 4 says: Replace proper metadata store information for the key MetadataDataStore.

    What should be the proper metadata store information? Also, what should NODEID be?

    thanks,

  • #13512 Reply

    Archived_User7
    Participant

    You don’t need to set nodeid. Looking at your config, remove everything after location since you probably don’t have kerb Eros setup.

  • #13513 Reply

    Archived_User64
    Participant

    Thanks William! more questions:

    substep 5. Make sure we have valid information for SSL_CERTIFICATE & SSL_PASSWD if required.

    question: What is that valid information?

    substep 6: Make sure we have proper zookeeper information for keys ZOOKEEPER_CONNECT_STRING, ZNODE_PATH & API_LEADER_SELECTION_ZK_NODE

    question: What are the proper key values for Zookeeper?

    thanks,

  • #13514 Reply

    Archived_User7
    Participant

    These are all items that are likely (or should be) covered in other parts of documentation.

    SSL_CERTIFICATE and SSL_PASSWD are used for MetadataAPIService and should be with the REST API or security documentation.

    SSL_CERTIFICATE is a bit of a bad name, it’s actually the fully qualified path to the keystore. For example /home/alison/keystore.jks. Creating this is described in the security section of documentation

    SSL_PASSWD is the password set when creating the keystore.

    ZOOKEEPER_CONNECT_STRING is exactly as it says. It’s the connect string for zookeeper. It follows the format “server:port”. i.e. 10.0.0.15:2181 or myZkServer:2181

    ZNODE_PATH is the base node on which kamanja is storing information on zookeeper. We typically set this as /kamanja but can be whatever the user wants as long as it follow the format /<node>.

    API_LEADER_SELECTION_ZK_NODE should be kept the same as ZNODE_PATH.

Reply To: My ClusterCfgMetadataAPIConfig.properties
Your information: