Home

2018
0
CloudGCP

Cloud Dataflow

Dataflow TextIO.write will shard your file, you can avoid it by withoutSharding() Dataflow can do everything you do in MapReduceParDo: parallel processingshould not contain any stateProcess one item

0
CloudGCP

Cloud Dataprep

Interactive graphical system for preparing structured or unstructured data for use in:analytics -> BigQueryvisualisation -> Data Studiotrain machine learning models -> Input integration : G

0
CloudGCP

Cloud Pub/Sub

feature summaryMessage persist for 7 dayslow-lantencyCapturing data and distributing dataUnified global server less service - not attached to a specific project, domain or userSmooth out traffic spike

0
CloudGCP

GCP Data Engineer preparation

Here is a summarization of what I have learned so far on GCP data engineering. It includes all of the resources I found, such as: Coursera Google Data Engineer courses Udemy courses Google Cloud Pla

0
DevGradle

Gradle fundamentals

Build12gradle cleangradle build Run application1234567# add application pluginapply plugin 'application'# add main classmainClassName = 'com.mycompany.Main'gradle run

0
DevTheory

Agile

To what I understand about the agile methodology, it’s not about whether we stand up or not in the meeting, or what’s the name of the roles in the team. It’s about two things, the values/principles of

0
DevTheory

Design Patterns in JDK

Design Pattern Example in JDK Description Singleton Runtime (hungry)NumberFormat Factory Integer.valueOfCLass.forName Replace constructorMethod name is more informative than constructor F

2017
0

Rest VS GraphQL

Hi guys, I have read some articles about Rest vs GraphQL, I would like to summarize a bit of what I learn so far, and give my suggestions: Background:People used to have their model, view and controll

0
OpsHotkeys

IDEA Hotkeys

Description Eclipse IntelliJ IDEA VS Code show the type hierachy F4 ctrl+h Findusages Ctrl+Shift+G ⌥F7 Go to line Ctrl+L ⌘L Open resource Ctrl+Shift+R ⇧⌘O Open type Ctrl+Shift+T ⌘O

0
OpsDocker

Dockerfile reference

Use Dockerfike create you own docker image. DockerFile contains basic image info mainainer info image CMD container CMD 1234567891011121314#第一行必须指令基于的基础镜像From ubutu#维护者信息MAINTAINER docker_user dock