Skip to main content
Ctrl+K

Cubed

For users

  • Getting Started
    • Why Cubed?
    • Installation
    • Demo
  • User Guide
    • Executors
    • Storage
    • Memory
    • Reliability
    • Scaling
  • Examples
  • API Reference
    • cubed.Array
    • cubed.Array.compute
    • cubed.Array.rechunk
    • cubed.Array.visualize
    • cubed.compute
    • cubed.visualize
    • cubed.from_array
    • cubed.from_zarr
    • cubed.store
    • cubed.to_zarr
    • cubed.apply_gufunc
    • cubed.map_blocks
    • cubed.nanmean
    • cubed.nansum
    • cubed.random.random
    • cubed.Callback
    • cubed.Spec
    • cubed.TaskEndEvent
    • cubed.measure_reserved_mem
    • cubed.runtime.executors.beam.BeamDagExecutor
    • cubed.runtime.executors.lithops.LithopsDagExecutor
    • cubed.runtime.executors.modal_async.AsyncModalDagExecutor
    • cubed.runtime.executors.python.PythonDagExecutor
  • Python Array API
  • Related Projects

For developers

  • Design
  • Operations
  • Computation
  • Contributing
  • Repository
  • Suggest edit
  • Open issue

User Guide

User Guide#

This guide introduces the concepts that will help you get the most out of Cubed.

  • Executors
    • Local Python executor
    • Which cloud service should I use?
    • Specifying an executor
  • Storage
    • Cloud storage
    • Deleting intermediate data
  • Memory
    • Allowed memory
    • Projected memory
    • Reserved memory
    • Chunk sizes
  • Reliability
    • Strong consistency
    • Retries
    • Timeouts
    • Stragglers
  • Scaling
    • Preface: Types of Scaling
    • Theoretical vs Practical Scaling of Cubed
    • Other Performance Considerations
    • Diagnosing Performance
    • Tips

previous

Demo

next

Executors

By Tom White

© Copyright 2022-2023, Tom White.