Try Flyte 2 locally with the devbox
Get started
Union.ai Docs logo
Union.ai Docs
Support
Signup
User guide
Tutorials
Reference
Integrations
Platform deployment
Zero Trust security
Community
Release notes
Union.ai Docs logo
Union.ai Docs
  • User guide
    • Overview
    • Quickstart
    • Core concepts
      • TaskEnvironment
      • Tasks
      • Runs and actions
      • Where your data lives
      • Apps
      • Projects and domains
      • Key capabilities
      • Settings
      • Basic project
      • Leases
    • Run modes
      • Run locally in Python
      • Run locally on the devbox
      • Run on a remote cluster
    • Configure tasks
      • Container images
      • Resources
      • Secrets
      • Caching
      • Reusable containers
      • Pod templates
      • Multiple environments
      • Retries and timeouts
      • Triggers
      • Interruptible tasks
      • Queues
      • Task plugins
      • Additional task settings
      • Logging
    • Build tasks
      • Files and directories
      • Volumes
      • Data classes and structures
      • DataFrames
      • Custom types
      • Custom context
      • Abort and cancel actions
      • Raw Container Tasks
      • Links
      • Reports
      • Notebooks
      • Remote tasks
      • Error handling
      • Traces
      • Grouping actions
      • Fanout
      • Controlling parallel execution
      • External conditions
      • Unit Testing Tasks
      • Other features
    • Run and deploy tasks
      • How task run works
      • Interact with runs and actions
      • Work with local data
      • Run command options
      • How task deployment works
      • Deploy command options
      • Packaging
      • Running Tasks via Webhooks
      • Deployment patterns
      • Run context
      • Entrypoint tasks
      • Run a Python script
      • Run with notifications
      • Re-run a run
      • Debug a run
    • Configure apps
      • App environments
      • Including additional files
      • Passing parameters into app environments
      • Autoscaling apps
      • Apps depending on other environments
    • Build apps
      • Single-script apps
      • Multi-script apps
      • Serving graphs
      • Hybrid app-task graphs
      • WebSocket apps
      • Browser apps
      • Secret-based authentication
      • Connector app
    • Native app integrations
      • Streamlit app
      • FastAPI app
      • vLLM app
      • SGLang app
      • Flyte webhook
    • Serve and deploy apps
      • How app serving works
      • How app custom domains work
      • How app deployment works
      • Activating and deactivating apps
      • Prefetching models
    • Build an agent
      • Pure Python agents
      • Flyte-native agents
      • Agent memory
      • Agent chat UI
      • Deploy an agent as a service
    • Agent framework integrations
      • LangGraph agents
      • PydanticAI agents
      • OpenAI agents
      • Bring your own framework
    • Build an MCP
      • User-defined MCP server
      • Flyte MCP server
    • Sandboxing
      • Workflow sandboxing
      • Programmatic tool calling for agents
      • Code sandboxing
    • Authenticating
    • User management
    • Cluster and workload management
      • Cluster pools
      • Clusters
      • Queues
    • Project patterns
      • Bring your own image (BYOI)
      • Monorepo with uv
      • CI/CD deployments
      • Resource management and multi-team scaling
    • Scale your runs
      • Data flow
      • Life of a run
      • Scale your workflows
      • Batch inference
    • Advanced project
      • Resilient generation
      • Agentic refinement
      • Parallel outputs
      • Serving app
    • Migration
      • From Flyte 1 to 2
        • Pure Python
        • Asynchronous model
        • Migration
        • Considerations
      • From Airflow to Flyte
        • Part 1 — vanilla operators
  • Tutorials
    • Biotech & healthcare
      • Genomic alignment
        • Brain tumor MRI classification
          • Cross-species gene comparison
            • Genomic variant effect prediction
              • Drug molecule screening agent
              • Geospatial
                • GPU-accelerated climate modeling
                  • Satellite image classification
                  • Financial services & fintech
                    • Multi-agent trading simulation
                      • Fraud detection with Feast
                        • Financial research agent
                        • Frontier AI
                          • Distributed LLM pretraining
                          • Computer vision
                            • Fine-tuning a VLM
                              • Multimodal retrieval evaluation
                                • RT-DETR object detection
                                • Agents
                                  • Autoresearch agent
                                    • Parallelized autoresearch agent
                                      • AutoSec researcher agent
                                        • Coding agent
                                          • Competitive intelligence agent
                                            • Deep research
                                              • LangGraph research agent
                                                • MLE bot
                                                  • Compliance monitoring agent
                                                    • Field data enrichment agent
                                                      • Support resolution agent
                                                        • Code mode analytics agent
                                                        • Context engineering
                                                          • Text-to-SQL prompt optimization
                                                            • Automatic prompt engineering
                                                            • Model training
                                                              • LLM fine-tuning with LoRA and QLoRA
                                                                • BERT emotion classification
                                                                  • Hyperparameter optimization
                                                                  • Data processing
                                                                    • Batching strategies
                                                                    • Reinforcement learning
                                                                      • RL for LLMs with GRPO and LoRA
                                                                      • Inference
                                                                        • Voice customer-service agent
                                                                      • Reference
                                                                        • LLM-optimized documentation
                                                                        • Migration from Flyte 1
                                                                          • Philosophy and imports
                                                                          • Container images
                                                                          • Configuration and CLI
                                                                          • Tasks and workflows
                                                                          • Secrets, resources, and caching
                                                                          • Parallelism and async
                                                                          • Triggers and dynamic workflows
                                                                          • Examples and common gotchas
                                                                        • Flyte CLI
                                                                        • Flyte SDK
                                                                          • Classes & Protocols
                                                                            • Packages
                                                                              • flyte
                                                                                • AppHandle
                                                                                • Backoff
                                                                                • BaseCheckpoint
                                                                                • Cache
                                                                                • CachePolicy
                                                                                • Checkpoint
                                                                                • ConditionWebhook
                                                                                • Cron
                                                                                • Device
                                                                                • Environment
                                                                                • FixedRate
                                                                                • Image
                                                                                • ImageBuild
                                                                                • Link
                                                                                • PodTemplate
                                                                                • Resources
                                                                                • RetryStrategy
                                                                                • ReusePolicy
                                                                                • Secret
                                                                                • TaskEnvironment
                                                                                • Timeout
                                                                                • Trigger
                                                                              • flyte.ai.agents
                                                                                • AccessDenied
                                                                                • Agent
                                                                                • AgentEvent
                                                                                • AgentProtocol
                                                                                • AgentResult
                                                                                • AgentTool
                                                                                • ConcurrencyError
                                                                                • LLMMessage
                                                                                • MCPServerSpec
                                                                                • MemoryMeta
                                                                                • MemoryStore
                                                                                • MemoryStoreError
                                                                                • ToolFn
                                                                              • flyte.ai.agents.agent
                                                                                • Agent
                                                                                • AgentEvent
                                                                              • flyte.ai.agents.memory
                                                                                • AccessDenied
                                                                                • ConcurrencyError
                                                                                • MemoryMeta
                                                                                • MemoryStore
                                                                                • MemoryStoreError
                                                                              • flyte.ai.agents.protocol
                                                                                • AgentProtocol
                                                                                • AgentResult
                                                                              • flyte.ai.chat
                                                                                • AgentChatAppEnvironment
                                                                                • CustomTheme
                                                                              • flyte.ai.chat.app
                                                                                • AgentChatAppEnvironment
                                                                                • CustomTheme
                                                                              • flyte.ai.mcp
                                                                                • FlyteMCPAppEnvironment
                                                                                • MCPAppEnvironment
                                                                              • flyte.app
                                                                                • AppEndpoint
                                                                                • AppEnvironment
                                                                                • ConnectorEnvironment
                                                                                • Domain
                                                                                • Link
                                                                                • Parameter
                                                                                • Port
                                                                                • RunOutput
                                                                                • Scaling
                                                                                • Timeouts
                                                                              • flyte.app.extras
                                                                                • FastAPIAppEnvironment
                                                                                • FastAPIPassthroughAuthMiddleware
                                                                                • FlyteWebhookAppEnvironment
                                                                              • flyte.clustered
                                                                                • ClusteredTaskEnvironment
                                                                                • ClusteredTaskTemplate
                                                                                • ClusterFailurePolicy
                                                                                • TorchRun
                                                                              • flyte.config
                                                                                • Config
                                                                              • flyte.connectors
                                                                                • AsyncConnector
                                                                                • AsyncConnectorExecutorMixin
                                                                                • ConnectorRegistry
                                                                                • ConnectorService
                                                                                • Resource
                                                                                • ResourceMeta
                                                                              • flyte.connectors.utils
                                                                                • flyte.durable
                                                                                  • flyte.errors
                                                                                    • ActionAbortedError
                                                                                    • ActionNotFoundError
                                                                                    • BaseRuntimeError
                                                                                    • CodeBundleError
                                                                                    • ConditionAlreadyExistsError
                                                                                    • ConditionFailedError
                                                                                    • ConditionNotFoundError
                                                                                    • ConditionTimedoutError
                                                                                    • CustomError
                                                                                    • DeploymentError
                                                                                    • ImageBuildError
                                                                                    • ImagePullBackOffError
                                                                                    • InitializationError
                                                                                    • InlineIOMaxBytesBreached
                                                                                    • InvalidImageNameError
                                                                                    • InvalidPackageError
                                                                                    • LogsNotYetAvailableError
                                                                                    • ModuleLoadError
                                                                                    • NonRecoverableError
                                                                                    • NotInTaskContextError
                                                                                    • OnlyAsyncIOSupportedError
                                                                                    • OOMError
                                                                                    • ParameterMaterializationError
                                                                                    • PrimaryContainerNotFoundError
                                                                                    • RemoteTaskNotFoundError
                                                                                    • RemoteTaskUsageError
                                                                                    • RestrictedTypeError
                                                                                    • RetriesExhaustedError
                                                                                    • RuntimeDataValidationError
                                                                                    • RuntimeSystemError
                                                                                    • RuntimeUnknownError
                                                                                    • RuntimeUserError
                                                                                    • SlowDownError
                                                                                    • TaskInterruptedError
                                                                                    • TaskTimeoutError
                                                                                    • TraceDoesNotAllowNestedTasksError
                                                                                    • UnionRpcError
                                                                                  • flyte.extend
                                                                                    • AsyncFunctionTaskTemplate
                                                                                    • ImageBuildEngine
                                                                                    • ImageBuilder
                                                                                    • ImageChecker
                                                                                    • TaskTemplate
                                                                                  • flyte.extras
                                                                                    • BatchStats
                                                                                    • ContainerTask
                                                                                    • CostEstimator
                                                                                    • DynamicBatcher
                                                                                    • Prompt
                                                                                    • Sleep
                                                                                    • SleepTask
                                                                                    • TokenBatcher
                                                                                    • TokenEstimator
                                                                                  • flyte.extras.shell
                                                                                    • FlagSpec
                                                                                    • Glob
                                                                                    • Stderr
                                                                                    • Stdout
                                                                                  • flyte.git
                                                                                    • GitStatus
                                                                                  • flyte.io
                                                                                    • DataFrame
                                                                                    • Dir
                                                                                    • EmptyDir
                                                                                    • File
                                                                                    • HashFunction
                                                                                  • flyte.io.extend
                                                                                    • DataFrameDecoder
                                                                                    • DataFrameEncoder
                                                                                    • DataFrameTransformerEngine
                                                                                  • flyte.models
                                                                                    • ActionID
                                                                                    • ActionPhase
                                                                                    • CheckpointPaths
                                                                                    • CodeBundle
                                                                                    • GroupData
                                                                                    • NativeInterface
                                                                                    • PathRewrite
                                                                                    • RawDataPath
                                                                                    • SerializationContext
                                                                                    • TaskContext
                                                                                  • flyte.notify
                                                                                    • Email
                                                                                    • NamedDelivery
                                                                                    • NamedRule
                                                                                    • Notification
                                                                                    • Slack
                                                                                    • Teams
                                                                                    • Webhook
                                                                                  • flyte.prefetch
                                                                                    • HuggingFaceModelInfo
                                                                                    • ShardConfig
                                                                                    • StoredModelInfo
                                                                                    • VLLMShardArgs
                                                                                  • flyte.remote
                                                                                    • Action
                                                                                    • ActionDetails
                                                                                    • ActionInputs
                                                                                    • ActionOutputs
                                                                                    • App
                                                                                    • Condition
                                                                                    • Project
                                                                                    • Run
                                                                                    • RunDetails
                                                                                    • Secret
                                                                                    • Settings
                                                                                    • Task
                                                                                    • TaskDetails
                                                                                    • TimeFilter
                                                                                    • Trigger
                                                                                    • User
                                                                                  • flyte.report
                                                                                    • Report
                                                                                  • flyte.sandbox
                                                                                    • CodeTaskTemplate
                                                                                    • ImageConfig
                                                                                    • SandboxedConfig
                                                                                    • SandboxedTaskTemplate
                                                                                  • flyte.storage
                                                                                    • ABFS
                                                                                    • GCS
                                                                                    • S3
                                                                                    • Storage
                                                                                  • flyte.syncify
                                                                                    • Syncify
                                                                                  • flyte.types
                                                                                    • FlytePickle
                                                                                    • Renderable
                                                                                    • TypeEngine
                                                                                    • TypeTransformer
                                                                                    • TypeTransformerFailedError
                                                                              • Union plugin
                                                                                • flyteplugins.union
                                                                                • Integrations
                                                                                  • Anthropic
                                                                                    • Classes
                                                                                      • Packages
                                                                                        • flyteplugins.anthropic
                                                                                          • Agent
                                                                                    • BigQuery
                                                                                      • Classes
                                                                                        • Packages
                                                                                          • flyteplugins.bigquery
                                                                                            • BigQueryConfig
                                                                                            • BigQueryConnector
                                                                                            • BigQueryTask
                                                                                      • Code generation
                                                                                        • Classes
                                                                                          • Packages
                                                                                            • flyteplugins.codegen
                                                                                              • AutoCoderAgent
                                                                                              • CodeGenEvalResult
                                                                                              • CodePlan
                                                                                              • CodeSolution
                                                                                              • ErrorDiagnosis
                                                                                              • ImageConfig
                                                                                        • Dask
                                                                                          • Classes
                                                                                            • Packages
                                                                                              • flyteplugins.dask
                                                                                                • Dask
                                                                                                • Scheduler
                                                                                                • WorkerGroup
                                                                                          • Databricks
                                                                                            • Classes
                                                                                              • Packages
                                                                                                • flyteplugins.databricks
                                                                                                  • Databricks
                                                                                                  • DatabricksConnector
                                                                                            • Gemini
                                                                                              • Classes
                                                                                                • Packages
                                                                                                  • flyteplugins.gemini
                                                                                                    • Agent
                                                                                              • Human-in-the-Loop
                                                                                                • Classes
                                                                                                  • Packages
                                                                                                    • flyteplugins.hitl
                                                                                                      • Event
                                                                                                • Hydra
                                                                                                  • flyteplugins.hydra
                                                                                                  • JSONL
                                                                                                    • Classes
                                                                                                      • Packages
                                                                                                        • flyteplugins.jsonl
                                                                                                          • JsonlDir
                                                                                                          • JsonlFile
                                                                                                    • MLflow
                                                                                                      • Classes
                                                                                                        • Packages
                                                                                                          • flyteplugins.mlflow
                                                                                                            • Mlflow
                                                                                                      • OmegaConf
                                                                                                        • flyteplugins.omegaconf
                                                                                                        • OpenAI
                                                                                                          • flyteplugins.openai.agents
                                                                                                          • Papermill
                                                                                                            • Classes
                                                                                                              • Packages
                                                                                                                • flyteplugins.papermill
                                                                                                                  • NotebookTask
                                                                                                            • Polars
                                                                                                              • Classes
                                                                                                                • Packages
                                                                                                                  • flyteplugins.polars.df_transformer
                                                                                                                    • ParquetToPolarsDecodingHandler
                                                                                                                    • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                                    • PolarsLazyFrameToParquetEncodingHandler
                                                                                                                    • PolarsToParquetEncodingHandler
                                                                                                              • PyTorch
                                                                                                                • Classes
                                                                                                                  • Packages
                                                                                                                    • flyteplugins.pytorch
                                                                                                                      • Elastic
                                                                                                                • Ray
                                                                                                                  • Classes
                                                                                                                    • Packages
                                                                                                                      • flyteplugins.ray
                                                                                                                        • HeadNodeConfig
                                                                                                                        • RayJobConfig
                                                                                                                        • WorkerNodeConfig
                                                                                                                  • SGLang
                                                                                                                    • Classes
                                                                                                                      • Packages
                                                                                                                        • flyteplugins.sglang
                                                                                                                          • SGLangAppEnvironment
                                                                                                                    • Snowflake
                                                                                                                      • Classes
                                                                                                                        • Packages
                                                                                                                          • flyteplugins.snowflake
                                                                                                                            • Snowflake
                                                                                                                            • SnowflakeConfig
                                                                                                                            • SnowflakeConnector
                                                                                                                      • Spark
                                                                                                                        • Classes
                                                                                                                          • Packages
                                                                                                                            • flyteplugins.spark
                                                                                                                              • ParquetToSparkDecoder
                                                                                                                              • Spark
                                                                                                                              • SparkToParquetEncoder
                                                                                                                        • vLLM
                                                                                                                          • Classes
                                                                                                                            • Packages
                                                                                                                              • flyteplugins.vllm
                                                                                                                                • VLLMAppEnvironment
                                                                                                                          • Weights & Biases
                                                                                                                            • Classes
                                                                                                                              • Packages
                                                                                                                                • flyteplugins.wandb
                                                                                                                                  • Wandb
                                                                                                                                  • WandbSweep
                                                                                                                          • Uctl CLI
                                                                                                                            • uctl
                                                                                                                            • uctl version
                                                                                                                            • uctl append
                                                                                                                              • uctl append identityassignments
                                                                                                                            • uctl apply
                                                                                                                              • uctl apply app
                                                                                                                              • uctl apply clusterconfig
                                                                                                                              • uctl apply clusterconfigid
                                                                                                                              • uctl apply clusterpoolconfig
                                                                                                                            • uctl config
                                                                                                                              • uctl config discover
                                                                                                                              • uctl config docs
                                                                                                                              • uctl config init
                                                                                                                              • uctl config validate
                                                                                                                            • uctl create
                                                                                                                              • uctl create app
                                                                                                                              • uctl create clusterpool
                                                                                                                              • uctl create clusterpoolassignment
                                                                                                                              • uctl create execution
                                                                                                                              • uctl create policy
                                                                                                                              • uctl create project
                                                                                                                              • uctl create role
                                                                                                                            • uctl delete
                                                                                                                              • uctl delete app
                                                                                                                              • uctl delete cluster
                                                                                                                              • uctl delete cluster-pool-attributes
                                                                                                                              • uctl delete cluster-resource-attribute
                                                                                                                              • uctl delete clusterconfig
                                                                                                                              • uctl delete clusterpool
                                                                                                                              • uctl delete clusterpoolassignment
                                                                                                                              • uctl delete execution
                                                                                                                              • uctl delete execution-cluster-label
                                                                                                                              • uctl delete execution-queue-attribute
                                                                                                                              • uctl delete identityassignments
                                                                                                                              • uctl delete plugin-override
                                                                                                                              • uctl delete policy
                                                                                                                              • uctl delete role
                                                                                                                              • uctl delete task-resource-attribute
                                                                                                                              • uctl delete workflow-execution-config
                                                                                                                            • uctl demo
                                                                                                                              • uctl demo exec
                                                                                                                              • uctl demo reload
                                                                                                                              • uctl demo start
                                                                                                                              • uctl demo status
                                                                                                                              • uctl demo teardown
                                                                                                                            • uctl get
                                                                                                                              • uctl get app
                                                                                                                              • uctl get cluster
                                                                                                                              • uctl get cluster-pool-attributes
                                                                                                                              • uctl get cluster-resource-attribute
                                                                                                                              • uctl get clusterconfig
                                                                                                                              • uctl get clusterconfigs
                                                                                                                              • uctl get clusterpool
                                                                                                                              • uctl get clusterpoolconfig
                                                                                                                              • uctl get clusterswithconfig
                                                                                                                              • uctl get echo
                                                                                                                              • uctl get execution
                                                                                                                              • uctl get execution-cluster-label
                                                                                                                              • uctl get execution-queue-attribute
                                                                                                                              • uctl get executionoperation
                                                                                                                              • uctl get identityassignment
                                                                                                                              • uctl get launchplan
                                                                                                                              • uctl get plugin-override
                                                                                                                              • uctl get policy
                                                                                                                              • uctl get project
                                                                                                                              • uctl get role
                                                                                                                              • uctl get task
                                                                                                                              • uctl get task-resource-attribute
                                                                                                                              • uctl get workflow
                                                                                                                              • uctl get workflow-execution-config
                                                                                                                            • uctl register
                                                                                                                              • uctl register examples
                                                                                                                              • uctl register files
                                                                                                                            • uctl update
                                                                                                                              • uctl update cluster-pool-attributes
                                                                                                                              • uctl update cluster-resource-attribute
                                                                                                                              • uctl update execution
                                                                                                                              • uctl update execution-cluster-label
                                                                                                                              • uctl update execution-queue-attribute
                                                                                                                              • uctl update launchplan
                                                                                                                              • uctl update launchplan-meta
                                                                                                                              • uctl update plugin-override
                                                                                                                              • uctl update project
                                                                                                                              • uctl update task-meta
                                                                                                                              • uctl update task-resource-attribute
                                                                                                                              • uctl update workflow-execution-config
                                                                                                                              • uctl update workflow-meta
                                                                                                                        • Integrations
                                                                                                                          • Anthropic
                                                                                                                            • BigQuery
                                                                                                                              • Code generation
                                                                                                                                • Dask
                                                                                                                                  • Databricks
                                                                                                                                    • Gemini
                                                                                                                                      • Hydra
                                                                                                                                        • MLflow
                                                                                                                                          • OmegaConf
                                                                                                                                            • OpenAI
                                                                                                                                              • Agent tools
                                                                                                                                            • OpenTelemetry
                                                                                                                                              • Pandera
                                                                                                                                                • Papermill
                                                                                                                                                  • PyTorch
                                                                                                                                                    • Ray
                                                                                                                                                      • Snowflake
                                                                                                                                                        • Spark
                                                                                                                                                          • Weights & Biases
                                                                                                                                                            • Experiments
                                                                                                                                                            • Distributed training
                                                                                                                                                            • Sweeps
                                                                                                                                                            • Downloading logs
                                                                                                                                                            • Constraints and best practices
                                                                                                                                                            • Manual integration
                                                                                                                                                        • Platform deployment
                                                                                                                                                          • BYOC deployment
                                                                                                                                                            • Platform architecture
                                                                                                                                                            • Configuring your data plane
                                                                                                                                                            • Multi-cluster and multi-cloud
                                                                                                                                                            • Data plane setup on AWS
                                                                                                                                                            • Data plane setup on GCP
                                                                                                                                                            • Data plane setup on Azure
                                                                                                                                                            • Data retention policy
                                                                                                                                                            • Enabling AWS resources
                                                                                                                                                              • Enabling AWS S3
                                                                                                                                                              • Enabling AWS ECR
                                                                                                                                                              • Enabling AWS Secrets Manager
                                                                                                                                                            • Enabling GCP resources
                                                                                                                                                              • Enabling Google Cloud Storage
                                                                                                                                                              • Enabling Google Artifact Registry
                                                                                                                                                              • Enabling Google Secret Manager
                                                                                                                                                              • Enabling BigQuery
                                                                                                                                                            • Enabling Azure resources
                                                                                                                                                              • Enabling Azure Blob Storage
                                                                                                                                                              • Enabling Azure Container Registry (ACR)
                                                                                                                                                              • Enabling Azure Key Vault
                                                                                                                                                            • Single sign on setup
                                                                                                                                                              • Google OpenID Connect
                                                                                                                                                              • Microsoft Entra ID (formerly Azure AD)
                                                                                                                                                              • Other identity providers
                                                                                                                                                          • Self-managed deployment
                                                                                                                                                            • Architecture
                                                                                                                                                              • Overview
                                                                                                                                                              • Kubernetes Access Controls
                                                                                                                                                            • Cluster recommendations
                                                                                                                                                            • Data plane setup on generic Kubernetes
                                                                                                                                                              • Prepare infrastructure
                                                                                                                                                              • Deploy the dataplane
                                                                                                                                                            • Data plane setup on AWS
                                                                                                                                                              • Prepare infrastructure
                                                                                                                                                              • Deploy the dataplane
                                                                                                                                                            • Data plane setup on GCP
                                                                                                                                                              • Prepare infrastructure
                                                                                                                                                              • Deploy the dataplane
                                                                                                                                                            • Data plane setup on Azure
                                                                                                                                                              • Prepare infrastructure
                                                                                                                                                              • Deploy the dataplane
                                                                                                                                                            • Data plane setup on OCI
                                                                                                                                                              • Prepare infrastructure
                                                                                                                                                              • Deploy the dataplane
                                                                                                                                                            • Data plane setup on CoreWeave
                                                                                                                                                              • Prepare infrastructure
                                                                                                                                                              • Deploy the dataplane
                                                                                                                                                            • Data plane setup on Crusoe
                                                                                                                                                              • Prepare infrastructure
                                                                                                                                                              • Deploy the dataplane
                                                                                                                                                            • Data plane setup on Nebius
                                                                                                                                                              • Prepare infrastructure
                                                                                                                                                              • Deploy the dataplane
                                                                                                                                                            • Configuration
                                                                                                                                                              • Node pools
                                                                                                                                                              • Authentication
                                                                                                                                                              • Code Viewer
                                                                                                                                                              • Image Builder
                                                                                                                                                              • Multiple Clusters
                                                                                                                                                              • Persistent logs
                                                                                                                                                              • Monitoring
                                                                                                                                                              • Secrets
                                                                                                                                                              • Data retention policies
                                                                                                                                                              • Compute plugins
                                                                                                                                                              • Namespace mapping
                                                                                                                                                              • Volumes
                                                                                                                                                            • Helm chart reference
                                                                                                                                                              • Dataplane chart
                                                                                                                                                              • Knative Operator chart
                                                                                                                                                          • Manage Union through Terraform
                                                                                                                                                            • Installation
                                                                                                                                                            • Resource management
                                                                                                                                                            • Security Best Practices
                                                                                                                                                        • Zero Trust security
                                                                                                                                                          • Architecture
                                                                                                                                                            • Two-plane separation
                                                                                                                                                            • Control plane
                                                                                                                                                            • Data plane
                                                                                                                                                            • Network architecture
                                                                                                                                                            • Sovereign Data Plane
                                                                                                                                                            • Private connectivity (BYOC)
                                                                                                                                                          • Data protection
                                                                                                                                                            • Data classification and residency
                                                                                                                                                            • Secrets management
                                                                                                                                                            • Logging and audit
                                                                                                                                                          • Identity and access
                                                                                                                                                            • Authentication
                                                                                                                                                            • Role-based access control
                                                                                                                                                            • Human access controls
                                                                                                                                                          • Compliance and governance
                                                                                                                                                            • Certifications and Trust Center
                                                                                                                                                            • HIPAA compliance
                                                                                                                                                            • GDPR alignment
                                                                                                                                                            • Standards compliance
                                                                                                                                                            • Shared responsibility model
                                                                                                                                                            • Organizational security
                                                                                                                                                            • Vulnerability management
                                                                                                                                                        • Community
                                                                                                                                                          • Contributing docs and examples
                                                                                                                                                            • Quick start
                                                                                                                                                            • Variants
                                                                                                                                                            • Versions
                                                                                                                                                            • Authoring
                                                                                                                                                            • Shortcodes
                                                                                                                                                            • Redirects
                                                                                                                                                            • API docs
                                                                                                                                                            • LLM-optimized documentation
                                                                                                                                                            • Publishing
                                                                                                                                                        • Release notes
                                                                                                                                                          Documentation navigation for Union including user guides, tutorials, API references, and integration examples
                                                                                                                                                          • Biotech & healthcare
                                                                                                                                                            • Genomic alignment
                                                                                                                                                              • Brain tumor MRI classification
                                                                                                                                                                • Cross-species gene comparison
                                                                                                                                                                  • Genomic variant effect prediction
                                                                                                                                                                    • Drug molecule screening agent
                                                                                                                                                                    • Geospatial
                                                                                                                                                                      • GPU-accelerated climate modeling
                                                                                                                                                                        • Satellite image classification
                                                                                                                                                                        • Financial services & fintech
                                                                                                                                                                          • Multi-agent trading simulation
                                                                                                                                                                            • Fraud detection with Feast
                                                                                                                                                                              • Financial research agent
                                                                                                                                                                              • Frontier AI
                                                                                                                                                                                • Distributed LLM pretraining
                                                                                                                                                                                • Computer vision
                                                                                                                                                                                  • Fine-tuning a VLM
                                                                                                                                                                                    • Multimodal retrieval evaluation
                                                                                                                                                                                      • RT-DETR object detection
                                                                                                                                                                                      • Agents
                                                                                                                                                                                        • Autoresearch agent
                                                                                                                                                                                          • Parallelized autoresearch agent
                                                                                                                                                                                            • AutoSec researcher agent
                                                                                                                                                                                              • Coding agent
                                                                                                                                                                                                • Competitive intelligence agent
                                                                                                                                                                                                  • Deep research
                                                                                                                                                                                                    • LangGraph research agent
                                                                                                                                                                                                      • MLE bot
                                                                                                                                                                                                        • Compliance monitoring agent
                                                                                                                                                                                                          • Field data enrichment agent
                                                                                                                                                                                                            • Support resolution agent
                                                                                                                                                                                                              • Code mode analytics agent
                                                                                                                                                                                                              • Context engineering
                                                                                                                                                                                                                • Text-to-SQL prompt optimization
                                                                                                                                                                                                                  • Automatic prompt engineering
                                                                                                                                                                                                                  • Model training
                                                                                                                                                                                                                    • LLM fine-tuning with LoRA and QLoRA
                                                                                                                                                                                                                      • BERT emotion classification
                                                                                                                                                                                                                        • Hyperparameter optimization
                                                                                                                                                                                                                        • Data processing
                                                                                                                                                                                                                          • Batching strategies
                                                                                                                                                                                                                          • Reinforcement learning
                                                                                                                                                                                                                            • RL for LLMs with GRPO and LoRA
                                                                                                                                                                                                                            • Inference
                                                                                                                                                                                                                              • Voice customer-service agent
                                                                                                                                                                                                                              Union.ai
                                                                                                                                                                                                                              Tutorials
                                                                                                                                                                                                                              Data processing

                                                                                                                                                                                                                              Data processing

                                                                                                                                                                                                                              Tutorials for large-scale data processing and batching strategies.

                                                                                                                                                                                                                              Batching strategies
                                                                                                                                                                                                                              Process millions of items efficiently with resilient, scalable batching patterns built on Flyte v2.
                                                                                                                                                                                                                              ← Hyperparameter optimizationBatching strategies →
                                                                                                                                                                                                                              LLM-optimized
                                                                                                                                                                                                                              This page Full docs index
                                                                                                                                                                                                                              On this page
                                                                                                                                                                                                                              404

                                                                                                                                                                                                                              Page not found

                                                                                                                                                                                                                              Showing closest match