Skip to content

Add BigQueryKmsKey Dataflow sample#1559

Merged
davidcavazos merged 4 commits into
GoogleCloudPlatform:masterfrom
davidcavazos:dataflow-cmek
Sep 6, 2019
Merged

Add BigQueryKmsKey Dataflow sample#1559
davidcavazos merged 4 commits into
GoogleCloudPlatform:masterfrom
davidcavazos:dataflow-cmek

Conversation

@davidcavazos

@davidcavazos davidcavazos commented Aug 23, 2019

Copy link
Copy Markdown

Creating a Dataflow sample to show how to use Customer-Managed Encryption Keys (CMEK) for the Using customer-managed encryption keys docs page.

Also updating the templates README for consistency.

@davidcavazos davidcavazos requested a review from a team August 23, 2019 20:00
@googlebot googlebot added the cla: yes This human has signed the Contributor License Agreement. label Aug 23, 2019
@kurtisvg kurtisvg added the blunderbuss: assign Instruct blunderbuss to assign someone label Aug 23, 2019
@blunderbuss-gcf blunderbuss-gcf Bot removed the blunderbuss: assign Instruct blunderbuss to assign someone label Aug 23, 2019
@davidcavazos davidcavazos force-pushed the dataflow-cmek branch 9 times, most recently from c663106 to c578384 Compare August 27, 2019 21:16
@davidcavazos

Copy link
Copy Markdown
Author

Hi @lesv, can you take a look at this whenever you have a chance? Thanks!

@lesv lesv left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's talk about this tomorrow, I may ask for a change in the README, but I'm very happy w/ the code.

Comment thread dataflow/README.md Outdated
Comment thread dataflow/encryption-keys/pom.xml Outdated

@davidcavazos davidcavazos left a comment

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I updated some dependency versions as well as the Java version to 11. I also updated the templates pom.xml file to follow the same format as the one in encryption-keys just for consistency.

Comment thread dataflow/README.md Outdated
Comment thread dataflow/encryption-keys/pom.xml Outdated
@davidcavazos davidcavazos merged commit b8fcb45 into GoogleCloudPlatform:master Sep 6, 2019
@davidcavazos davidcavazos deleted the dataflow-cmek branch September 6, 2019 18:59
@mik-laj

mik-laj commented Jun 15, 2020

Copy link
Copy Markdown
Contributor

@davidcavazos Apache Beam does not have full support for Java 11. The Polidea team is still working on it. Does Dataflow Runner fully support Jave 11? I am not sure if we should use this version.

@davidcavazos

Copy link
Copy Markdown
Author

Hi @mik-laj, although Apache Beam SDK itself isn't in Java 11 yet, the package can still be used by Java 11 applications. I would go ahead and try to stick with the latest Java version while the Beam SDK catches up. This would mean not having to migrate from one version to another once the old version drops support (like what happened with Python 2), which we've seen can be a huge effort.

I haven't run into any issues by using Java 11, so I would still recommend using the latest version to try to keep up to date.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla: yes This human has signed the Contributor License Agreement.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants