Skip to main content
Ctrl+K
Logo image
  • Introduction
  • Software Architecture
  • SYCL
  • oneDPL
    • Namespaces
    • Parallel API
    • SYCL Kernels API
  • oneDNN
    • Introduction
    • Conventions
    • Execution Model
    • Data model
      • Data types
        • Bfloat16
        • Int8
      • Memory
        • Memory Formats
        • Memory Descriptors and Objects
    • Primitives
      • Common Definitions
      • Attributes
        • Post-ops
      • Batch Normalization
      • Binary
      • Concat
      • Convolution and Deconvolution
      • Elementwise
      • Inner Product
      • Layer normalization
      • Local Response Normalization
      • Matrix Multiplication
      • Pooling
      • Prelu
      • Reduction
      • Reorder
      • Resampling
      • RNN
      • Shuffle
      • Softmax
      • Sum
    • Graph extension
      • Common Definitions
      • Programming Model
      • Data Model
      • Operation Set
        • Abs
        • AbsBackward
        • Add
        • AvgPool
        • AvgPoolBackward
        • BatchNormForwardTraining
        • BatchNormInference
        • BatchNormTrainingBackward
        • BiasAdd
        • BiasAddBackward
        • Clamp
        • ClampBackward
        • Concat
        • ConvTranspose
        • ConvTransposeBackwardData
        • ConvTransposeBackwardWeights
        • Convolution
        • ConvolutionBackwardData
        • ConvolutionBackwardWeights
        • Dequantize
        • Divide
        • DynamicDequantize
        • DynamicQuantize
        • Elu
        • EluBackward
        • End
        • Exp
        • GELU
        • GELUBackward
        • HardSigmoid
        • HardSigmoidBackward
        • HardSwish
        • HardSwishBackward
        • Interpolate
        • InterpolateBackward
        • LayerNorm
        • LayerNormBackward
        • LeakyReLU
        • Log
        • LogSoftmax
        • LogSoftmaxBackward
        • MatMul
        • MaxPool
        • MaxPoolBackward
        • Maximum
        • Minimum
        • Mish
        • MishBackward
        • Multiply
        • Pow
        • PReLU
        • PReLUBackward
        • Quantize
        • ReLU
        • ReLUBackward
        • Reciprocal
        • ReduceL1
        • ReduceL2
        • ReduceMax
        • ReduceMean
        • ReduceMin
        • ReduceProd
        • ReduceSum
        • Reorder
        • Round
        • Select
        • Sigmoid
        • SigmoidBackward
        • SoftPlus
        • SoftPlusBackward
        • SoftMax
        • SoftMaxBackward
        • Sqrt
        • SqrtBackward
        • Square
        • SquaredDifference
        • StaticReshape
        • StaticTranspose
        • Subtract
        • Tanh
        • TanhBackward
        • TypeCast
        • Wildcard
  • oneCCL
    • Introduction
    • Namespaces
    • Current Version of this oneCCL Specification
    • Definitions
      • oneCCL Concepts
      • Communication Operations
        • Datatypes
        • Reductions
        • Collective Operations
        • Operation Attributes
        • Operation Progress Tracking
      • Error handling
    • Programming Model
      • Generic Workflow
  • Level Zero
  • oneDAL
    • Introduction
    • Glossary
    • Mathematical Notations
    • Programming model
      • End-to-end example
      • Descriptors
      • Operations
        • Supported operations
      • Computational modes
    • Common Interface
      • Current Version of this oneDAL Specification
      • Header files
      • Error handling
      • Common type definitions
    • Data management
      • Array
      • Accessors
        • Column accessor
        • Row accessor
      • Data Sources
        • CSV data source
      • Tables
        • Homogeneous table
    • Algorithms
      • Clustering
        • K-Means
        • K-Means initialization
      • Nearest Neighbors (kNN)
        • k-Nearest Neighbors Classification (k-NN)
      • Decomposition
        • Principal Components Analysis (PCA)
    • Appendix
      • k-d Tree
    • Bibliography
  • oneTBB
    • General Information
      • Introduction
      • Notational Conventions
      • Identifiers
      • Named Requirements
        • Range
        • Splittable
        • ParallelForBody
        • ParallelForFunc
        • ParallelForIndex
        • ParallelReduceBody
        • ParallelReduceFunc
        • ParallelReduceReduction
        • ParallelForEachBody
        • ContainerBasedSequence
        • ParallelScanBody
        • ParallelScanCombine
        • ParallelScanFunc
        • BlockedRangeValue
        • FilterBody
        • Mutex
        • ReaderWriterMutex
        • HashCompare
        • ContainerRange
        • SuspendFunc
        • AsyncNodeBody
        • ContinueNodeBody
        • GatewayType
        • FunctionNodeBody
        • JoinNodeFunctionObject
        • InputNodeBody
        • MultifunctionNodeBody
        • Sequencer
      • Thread Safety
    • oneTBB Interfaces
      • Configuration
        • Namespaces
        • Version Information
        • Enabling Debugging Features
        • Feature Macros
      • Algorithms
        • collaborative_call_once
        • parallel_for
        • parallel_reduce
        • parallel_deterministic_reduce
        • parallel_scan
        • parallel_for_each
        • parallel_invoke
        • parallel_pipeline
        • parallel_sort
        • blocked_range
        • blocked_range2d
        • blocked_range3d
        • auto_partitioner
        • affinity_partitioner
        • static_partitioner
        • simple_partitioner
        • proportional split
        • split
      • Flow Graph
        • graph
        • graph_node
        • sender
        • receiver
        • Forwarding and Buffering
        • continue_node
        • function_node
        • input_node
        • multifunction_node
        • async_node
        • Function Nodes Policies
        • Nodes Priorities
        • Predefined Concurrency Limits
        • copy_body
        • overwrite_node
        • write_once_node
        • buffer_node
        • queue_node
        • priority_queue_node
        • sequencer_node
        • limiter_node
        • broadcast_node
        • join_node
        • split_node
        • indexer_node
        • composite_node
        • input_port
        • output_port
        • make_edge
        • remove_edge
        • continue_msg
        • tagged_msg
        • Dependency Flow Graph Example
        • Message Flow Graph Example
      • Task Scheduler
        • task_group_context
        • global_control
        • Resumable tasks
        • task_scheduler_handle
        • task_group
        • task_group_status
        • task_handle
        • task_arena
        • this_task_arena
        • task_scheduler_observer
        • attach tag type
      • Containers
        • concurrent_vector
        • concurrent_queue
        • concurrent_bounded_queue
        • concurrent_priority_queue
        • concurrent_hash_map
        • concurrent_unordered_map
        • concurrent_unordered_multimap
        • concurrent_unordered_set
        • concurrent_unordered_multiset
        • concurrent_map
        • concurrent_multimap
        • concurrent_set
        • concurrent_multiset
        • tbb_hash_compare
        • Node handles
      • Thread Local Storage
        • combinable
        • enumerable_thread_specific
        • flattened2d
    • oneTBB Auxiliary Interfaces
      • Memory Allocation
        • tbb_allocator
        • scalable_allocator
        • cache_aligned_allocator
        • cache_aligned_resource
        • scalable_memory_resource
        • C Interface to Scalable Allocator
      • Mutual Exclusion
        • mutex
        • rw_mutex
        • spin_mutex
        • spin_rw_mutex
        • speculative_spin_mutex
        • speculative_spin_rw_mutex
        • queuing_mutex
        • queuing_rw_mutex
        • null_mutex
        • null_rw_mutex
      • Timing
        • tick_count class
      • info Namespace
    • oneTBB Deprecated Interfaces
      • task_arena::attach
  • oneMKL
    • oneMKL Architecture
    • oneMKL Domains
      • Matrix Storage
      • Scalar Arguments in BLAS
      • BLAS Routines
        • BLAS Level 1 Routines
        • BLAS Level 2 Routines
        • BLAS Level 3 Routines
        • BLAS-like Extensions
      • LAPACK Routines
        • geqrf
        • geqrf_scratchpad_size
        • gerqf
        • gerqf_scratchpad_size
        • getrf
        • getrf_scratchpad_size
        • getri
        • getri_scratchpad_size
        • getrs
        • getrs_scratchpad_size
        • hetrf
        • hetrf_scratchpad_size
        • orgqr
        • orgqr_scratchpad_size
        • ormqr
        • ormqr_scratchpad_size
        • ormrq
        • ormrq_scratchpad_size
        • potrf
        • potrf_scratchpad_size
        • potri
        • potri_scratchpad_size
        • potrs
        • potrs_scratchpad_size
        • sytrf
        • sytrf_scratchpad_size
        • trtrs
        • trtrs_scratchpad_size
        • ungqr
        • ungqr_scratchpad_size
        • unmqr
        • unmqr_scratchpad_size
        • unmrq
        • unmrq_scratchpad_size
        • gebrd
        • gebrd_scratchpad_size
        • gesvd
        • gesvd_scratchpad_size
        • heevd
        • heevd_scratchpad_size
        • hegvd
        • hegvd_scratchpad_size
        • hetrd
        • hetrd_scratchpad_size
        • orgbr
        • orgbr_scratchpad_size
        • orgtr
        • orgtr_scratchpad_size
        • ormtr
        • ormtr_scratchpad_size
        • syevd
        • syevd_scratchpad_size
        • sygvd
        • sygvd_scratchpad_size
        • sytrd
        • sytrd_scratchpad_size
        • ungbr
        • ungbr_scratchpad_size
        • ungtr
        • ungtr_scratchpad_size
        • unmtr
        • unmtr_scratchpad_size
        • geqrf_batch
        • geqrf_batch_scratchpad_size
        • getrf_batch
        • getrf_batch_scratchpad_size
        • getri_batch
        • getri_batch_scratchpad_size
        • getrs_batch
        • getrs_batch_scratchpad_size
        • orgqr_batch
        • orgqr_batch_scratchpad_size
        • potrf_batch
        • potrf_batch_scratchpad_size
        • potrs_batch
        • potrs_batch_scratchpad_size
        • ungqr_batch
        • ungqr_batch_scratchpad_size
      • Sparse BLAS
        • init_matrix_handle
        • release_matrix_handle
        • set_csr_data
        • gemm
        • optimize_gemm
        • gemv
        • gemvdot
        • optimize_gemv
        • symv
        • optimize_symv
        • trmv
        • optimize_trmv
        • trsv
        • optimize_trsv
        • Supported Types
        • Sparse storage formats
      • Discrete Fourier Transform Functions
        • The descriptor class
        • DFT-related scoped enumeration types
        • compute_forward
        • compute_backward
      • Random Number Generators (RNG)
        • Random Number Generators Host Routines
        • Random Number Generators Device Routines
      • Summary Statistics
        • oneMKL Summary Statistics Usage Model
        • dataset
        • Summary Statistics Routines
        • Service Routines
      • Vector Math
        • Special Value Notations
        • VM Mathematical Functions
        • VM Service Functions
        • Exceptions
        • Bibliography
    • oneMKL Appendix
  • Releases
  • Legal Notices and Disclaimers
  • Suggest edit
  • Open issue
  • .rst

Communication Operations

Communication Operations#

This section covers communication operations defined by oneCCL specification.

  • Datatypes
  • Reductions
  • Collective Operations
  • Operation Attributes
  • Operation Progress Tracking

previous

oneCCL Concepts

next

Datatypes

© Copyright 2022, Intel Corporation.