Skip to content

Feel free to contact me via LinkedIn or Email

KC's Data & Life Notes

Configure Catalogs

Initializing search

Home
About Me
Side Projects
Learning Notes
Blog
Tags
Recaps

KC's Data & Life Notes

Home
Home
About Me
About Me
- Work Experience
  Work Experience
- Public Speakings
  Public Speakings
Side Projects
Side Projects
- Fraud Detection (Data2ML Ops)
  Fraud Detection (Data2ML Ops)
  - Prerequisites
  - dbt
    dbt
    
    Modeling Data
  - Feast
    Feast
    
    Modeling Features
    
    Deploy Feast on Kubernetes
  - MinIO
    MinIO
    
    Deploy MinIO on Kubernetes
  - MLflow
    MLflow
    
    Deploy MLflow on Kubernetes
    
    Track Hyperparameter Optimization with Optuna and MLflow
  - Ray
    Ray
    
    What, Why, When
    
    How Ray Works?
    
    In the Bigger Picture
    
    Deploy Ray Cluster on Kubernetes Using KubeRay
    
    Integrate Ray Tune with Optuna, Imblearn, MLflow and MinIO
    
    Submit a Ray Tune Job to Your Ray Cluster
  - KServe
    KServe
    
    What, Why, When
    
    How KServe Works?
    
    In the Bigger Picture
    
    Install Kserve in Serverless Mode
    
    Deploy Your Model on Kubernetes
    
    Move Feature Retrieval to KServe Transformer
    
    Write a Custom KServe Transformer with Feast Integration
    
    Deploy Your Model on Kubernetes with Feast Transformer
- Retail Lakehouse
  Retail Lakehouse
  - Prerequisites
  - Deployment
  - Argo CD
    Argo CD
    
    Argo CD Deployment
    
    Argo CD CLI
    
    How the GitOps Deployment Works
  - Kafka
    Kafka
    
    Overview
    
    Kafka Cluster Deployment
    
    MySQL Deployment
    
    Debezium MySQL Kafka Connector Deployment
    
    Kafka Cluster Deployment
  - Trino
    Trino
    
    How It Works?
    
    Trino Cluster Deployment
    
    Configure OAuth 2.0 Authentication
    
    Fault-tolerant Execution in Trino
    
    Configure Catalogs Configure Catalogs
    On This Page
    
    BigQuery
    
    Iceberg
    
    Faker
    
    Faker Connector
    
    Join Optimization
    
    Event Listeners
  - MinIO
    MinIO
    
    MinIO Deployment
  - Apache Polaris
    Apache Polaris
    
    Apache Polaris Deployment
    
    Interacting with Apache Polaris
  - Observability
    Observability
    
    Overview
    
    How Prometheus Works?
    
    Prometheus Deployment
    
    How Thanos Works?
    
    Thanos Deployment
    
    What is OpenTelemetry?
    
    How OpenTelemetry Works?
    
    OpenTelemetry Deployment
    
    Monitoring with Prometheus and Grafana
  - Iceberg Table Maintenance
    Iceberg Table Maintenance
    
    Iceberg Table Maintenance
    
    Troubleshooting: Iceberg Spark Runtime 版本相容性
  - Troubleshooting
    Troubleshooting
    
    Troubleshooting: Minikube Worker Node NotReady
    
    Troubleshooting: Minikube Worker Node 無法拉取外部 Container Image
    
    排查 Spark Operator 的 Leader Election 崩潰循環
    
    MinIO Data Recovery: hostPath Volume 與節點重排程問題
    
    Troubleshooting: Catalog Reset After Polaris Restart
  - Apache Iceberg - Spark Quickstart
    Apache Iceberg - Spark Quickstart
    
    Deployment
    
    Getting Started
    
    Integrated Audits Demo
    
    Table Maintenance Spark Procedures
    
    Write-Audit-Publish with Branches in Apache Iceberg
    
    View Support
- Unified SQL-based Data Pipelines
  Unified SQL-based Data Pipelines
- Trending Content Prediction
  Trending Content Prediction
Learning Notes
Learning Notes
- Spark
  Spark
  - How Spark Works
  - Spark Performance Tuning
  - Learning Spark (2020)
    Learning Spark (2020)
    
    Ch1 & 2 Introduction to Spark
    
    Ch3 Structured APIs
    
    Ch7 Optimizing and Tuning Spark Applications
- Iceberg
  Iceberg
  - Best Practices for Optimizing Apache Iceberg Workloads in AWS
  - The Definitive Guide (2020)
    The Definitive Guide (2020)
    
    Ch4 Optimizing the Performance of Apache Iceberg
  - Deep Dive into Kafka Connect Icerberg Sink Connector
  - Migrate from Hive to Iceberg
  - Disaster Recovery with Apache Iceberg
  - Iceberg Resources
  - Apache Iceberg in Production: Insights from Netflix in 2023
- Kafka
  Kafka
  - Exactly Once Semantics in Kafka
  - Deep Dive into Kafka Connect Icerberg Sink Connector
- Flink
  Flink
  - How Flink Works
- Flagger
  Flagger
  - How Flagger Works? - Istio Integration
  - Flagger Istio Integration
- Istio
  Istio
  - How Istio Works?
- Prometheus
  Prometheus
  - Up & Running (2023)
    Up & Running (2023)
    
    Ch3 Instrumentation
- OpenTelemetry
  OpenTelemetry
  - Learning OpenTelemetry (2024)
    Learning OpenTelemetry (2024)
    
    Ch2 Why Use OpenTelemetry?
    
    Ch3 Overview
    
    Ch4 Architecture
    
    Ch7 Observing Infrastructure
    
    Ch8 Designing Telemetry Pipelines
    
    Ch3 Instrumentation
- Karpenter
  Karpenter
  - Karpenter Best Practices
  - How Karpenter Works
- KEDA
  KEDA
  - How KEDA Works
- Airflow
  Airflow
  - How Airflow Works?
- Polaris
  Polaris
  - Apache Polaris Policy
  - Apache Polaris Resources
- DDIA
  DDIA
  - Ch8 transactions
- Hive
  Hive
  - Hive Architecture
- SQLMesh
  SQLMesh
  - Comparisons: SQLMesh vs dbt Core
- dbt
  dbt
- Streaming Processing
  Streaming Processing
  - Streaming Processing Window Types
- RisingWave
  RisingWave
- Treasure Data
  Treasure Data
- LeetCode
  LeetCode
- Restful APIs with Flask
  Restful APIs with Flask
  - Basics
  - Advanced
- Rosetta
  Rosetta
- Shortcuts
  Shortcuts
  - Git
  - gh
  - lazygit
  - Editors
  - tmux
  - chezmoi
  - gum
  - uv
  - Containers & Kubernetes
Blog
Blog
- Archive
  Archive
  - 2026
  - 2025
- Categories
  Categories
  - CI/CD
  - Data
  - MkDocs
Tags
Recaps
Recaps

On This Page

BigQuery
Iceberg
Faker

Configure Catalogs¶

The following catalogs are configured:

trino/values-template.yaml - Catalogs Configuration

BigQuery¶

Iceberg¶

Faker¶

Was this page helpful?

Thanks for your feedback!

Thanks for your feedback!

Fault-tolerant Execution in Trino

Faker Connector

Made with Material for MkDocs