Releases Doris Connectors
Doris Connectors currently contains:
- Flink Doris Connector
- Spark Doris Connector
The code base is separate from the main Doris code base and is located at:
Preparing for release
First, see the release preparation documentation to prepare for the release.
Releasing to Maven
Let's take the release of Spark Connector 1.2.0 as an example.
1. Prepare branch
Create a branch in the code base: release-1.2.0, and checkout to this branch.
2. Release to Maven staging
Because Spark Connector releases different releases for different Spark versions (such as 2.3, 3.1, 3.2), we need to process each version separately at compile time.
Let's take Spark version 2.3 and scala version 2.11 as examples:
mvn clean install \
Note: For related parameters, please refer to the compilation command in the build.sh script, and revision is the version number to be released this time.
mvn deploy \
After successful execution, you can find the newly released version in https://repository.apache.org/#stagingRepositories:
Note that the
.asc signature file needs to be included.
If the operation is wrong, you need to drop the staging. Then perform the above steps again.
After checking, click the
close button in the figure to complete the staging release.
3. Prepare svn
Check out the svn repository:
svn co https://dist.apache.org/repos/dist/dev/doris/
Package tag source code, and generate signature file and sha256 verification file. Here we take
1.14_2.12-1.0.0 as an example. Other tag operations are the same
git archive --format=tar release-1.2.0 --prefix=apache-doris-spark-connector-1.2.0-src/ | gzip > apache-doris-spark-connector-1.2.0-src.tar.gz
gpg -u firstname.lastname@example.org --armor --output apache-doris-spark-connector-1.2.0-src.tar.gz.asc --detach-sign apache-doris-spark-connector-1.2.0- src.tar.gz
sha512sum apache-doris-spark-connector-1.2.0-src.tar.gz > apache-doris-spark-connector-1.2.0-src.tar.gz.sha512
shasum -a 512 apache-doris-spark-connector-1.2.0-src.tar.gz > apache-doris-spark-connector-1.2.0-src.tar.gz.sha512
You end up with three files:
Move these three files to the svn directory:
The final svn directory structure is similar to:
| | |____apache-doris-0.15.0-incubating-src.tar.gz.sha512
| | |____apache-doris-0.15.0-incubating-src.tar.gz.asc
| | |____apache-doris-0.15.0-incubating-src.tar.gz
| | |____apache-doris-spark-connector-1.2.0-src.tar.gz
| | |____apache-doris-spark-connector-1.2.0-src.tar.gz.asc
| | |____apache-doris-spark-connector-1.2.0-src.tar.gz.sha512
Among them, 0.15 is the directory of Doris main code, and
spark-connector/1.2.0 is the content of this release.
Note, for the preparation of the KEYS file, please refer to the introduction in Release Preparation.
Initiate a vote in the dev@doris mail group, the template is as follows:
This is a call for the vote to release Apache Doris Spark Connector 1.2.0
The git tag for the release:
Release Notes are here:
Thanks to everyone who has contributed to this release.
The release candidates:
Maven 2 staging repository:
KEYS file is available here:
To verify and build, you can refer to the following link:
The vote will be open for at least 72 hours.
[ ] +1 Approve the release
[ ] +0 No opinion
[ ] -1 Do not release this package because ...
Please refer to the Complete Release document to complete the entire release process.
APPENDIX: Releasing TO SNAPSHOT
Snapshot is not an Apache Release version, it is only used for preview before release. After being discussed and approved by the PMC, the Snapshot version can be released
Switch to the spark connector directory, we take spark version 2.3, scala 2.11 as an example
mvn deploy \
Afterwards you can see the snapshot version here: