GitHub puppet-kafka

The kafka module for managing the installation and configuration of Apache Kafka

<!--
Thank you for contributing to this project!

• This project has a Contributor Code of Conduct: https://voxpupuli.org/coc/
• Please check that here is no existing issue or PR that addresses your problem.
• Our vulnerabilities reporting process is at https://voxpupuli.org/security/

-->

Pull Request (PR) description

<!--
It replace the kafka.logs.dir to logdir, since code does not except the parameter kafka.logs.dir _
-->

This Pull Request (PR) fixes the following issues

<!--
Replace this comment with the list of issues or n/a.
Use format:
n/a
-->

<!--
Thank you for contributing to this project!

• This project has a Contributor Code of Conduct: https://voxpupuli.org/coc/
• Please check that here is no existing issue or PR that addresses your problem.
• Our vulnerabilities reporting process is at https://voxpupuli.org/security/

-->

Pull Request (PR) description

<!--
Replace this comment with a description of your pull request.
-->

This Pull Request (PR) fixes the following issues

<!--
Replace this comment with the list of issues or n/a.
Use format:
Fixes #123
Fixes #124
-->

<!--
Thank you for contributing to this project!

• This project has a Contributor Code of Conduct: https://voxpupuli.org/coc/
• Please check that here is no existing issue or PR that addresses your problem.
• Our vulnerabilities reporting process is at https://voxpupuli.org/security/

-->

Pull Request (PR) description

We'd like to be able to easily create multiple mirror services from hieradata like that:


$mirrors.each |$title, $mirror| {
kafka::mirror { $title:
consumer_config => $mirror['consumer_config'],
........
}
}


And we'd like to be able to easily notify all mirror services like that:


java_ks { "......:truststore":
ensure => latest,
certificate => "${properties_dir}/.....pem",
target => "${properties_dir}/.....jks",
password => "........",
path => ["${jdk_path}/jre/bin", "/bin", "/usr/bin"],
trustcacerts => true
} ~> Kafka::Mirror <| |>


And we'd like to be able to change the path of /etc/systemd/system.

This Pull Request (PR) fixes the following issues

If kafka has been configured with SASL and self-signed SSL certificates and using zookeeper is not an options (kraft is being used), you need to pass --command-config in order to be able to manage topics.

/opt/kafka/bin/kafka-topics.sh --bootstrap-server kafka01.example.com:9093 --command-config /opt/kafka/config/admin.config --describe

/opt/kafka/config/admin.config:


sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="<%= $kafka_admin_user %>" password="<%= $kafka_admin_password %>";
security.protocol=SASL_SSL
sasl.mechanism=PLAIN
<%- if $self_signed_certs { -%>
ssl.truststore.location=<%= $kafka_keystore_path %>
ssl.truststore.password=<%= $jks_password %>
ssl.truststore.type=JKS
<%- } -%>