OFFLOAD

specifier

Can be any of the following:

• TARGET (target-name [:target-number])

• IF (if-specifier)

  An optional specifier. Include it to allow a test at execution time for whether or not the executable should try to offload the statement.

• SIGNAL (tag)

  An optional specifier. Include it to enable the CPU to continue execution after initiating the offload.

  If this clause is used, the computation performed by the offload, and any results returned from the offload using OUT clauses, occur concurrently with the CPU execution of the code after the directive.

  If this clause is not used, then the entire offload and associated data transfer are executed synchronously: the CPU will not continue execution past the directive until the computation performed by the offload has completed.

• WAIT (tag [, tag, ...])

  An optional specifier. Include it to specify a wait for completion of a previously initiated asynchronous data transfer or asynchronous computation.

• MANDATORY

  An optional specifier. Include it to specify that execution on the coprocessor is required. Execution on the CPU is not allowed. If the correct target hardware needed to run the offloaded code is not available on the system, the program fails with an error message.

• offload-parameter [[,] offload-parameter]

You cannot specify both MANDATORY and IF.

target-name

Is an identifier that represents the target. The only allowable target name is MIC.

target-number

(Optional) Is an integer expression whose value is interpreted as follows:

If you don't specify this argument, the runtime system chooses whether to execute the code on the CPU or the coprocessor, and if multiple coprocessors are available, on which coprocessor.

For example, in a system with 4 coprocessors:

• Specifying 2 or 6 tells the runtime systems to use coprocessor 2 for the transfer, because both MOD(2,4) and MOD(6,4) equal 2.

• Specifying 1000 tells the runtime systems to use coprocessor 0 for the transfer, because MOD(1000,4) = 0.

if-specifier

Is a Boolean expression.

If the expression evaluates to true, then the program attempts to offload the statement. If the specified target coprocessor is absent from the system or not available at that time because it is fully loaded, then the offloaded code executes on the CPU.

If the expression evaluates to false, then the offloaded code executes on the CPU and none of the other OFFLOAD clauses have any effect.

tag

Is an integer expression.

When used with SIGNAL, this integer expression is a memory reference and is associated with an asynchronous computation or an asynchronous data transfer. This expression can be used in subsequent WAIT clauses in other OFFLOAD directives.

When used with WAIT, this integer expression is asynchronous input data that is a memory reference. Use the same value that you specified in the SIGNAL specifier to start the asynchronous computation or data transfer with the OFFLOAD or OFFLOAD_TRANSFER directive.

offload-parameter

Can be any of the following clauses:

• IN ( identifier[, identifier…] [: modifier[[,] modifier… ] ] )

• OUT ( identifier[, identifier…] [: modifier[[,] modifier… ] ] )

• INOUT ( identifier[, identifier…] [: modifier[[,] modifier… ] ] )

• NOCOPY ( identifier[, identifier…] [: modifier[[,] modifier… ] ] )

When a program runs in a heterogeneous environment, program variables are copied back and forth between the CPU and the target. The offload-parameter is a specification for controlling the direction in which variables are copied, and for pointers, the amount of data that is copied.

An IN or OUT element-count-expr expression (see description below within modifier) is evaluated at a point in the program before the statement or clause in which it is used.

An array variable whose size is known from its declaration is copied in its entirety. If a subset of an array is to be processed, use the name of the starting element of the subset and the element-count-expr to transfer the array subset.

Because a data pointer variable not listed in an IN clause is uninitialized within the offload region, it must be assigned a value on the target before it can be referenced.

identifier

Is a variable, a subscripted variable, an array slice, or a component reference.

modifier

Is one of the following:

• LENGTH ( element-count-expr )

  where element-count-expr is an integer expression, computed at runtime. Use it with:

  • Integer pointer variables (not Fortran 90 POINTERs)

    Pointer variable values themselves are never copied across the host/target interface because there is no correspondence between the memory addresses of the host CPU and the target. Instead, objects that an integer pointer points to are copied to or from the target, and the value of the pointer variable is recreated. By default, a single element is copied.

    Use element-count-expr to specify how many elements pointed to should be considered as data. If the expression value is zero or negative, the program fails with an error message.

  • Arrays (including assumed-size)

    element-count-expr specifies a number of elements copied between the CPU and target.

• ALLOC_IF ( condition ) | FREE_IF (condition )

  where condition is a Boolean expression.

  The ALLOC_IF modifier specifies a Boolean condition that controls whether the allocatable variables in the IN clause will be allocated a new block of memory on the target when the offload is executed on the target. If the expression evaluates to true, a new memory allocation is performed for each variable listed in the clause. If the condition evaluates to false, the existing allocated values on the target are reused (data persistence). You must ensure that a block of memory of sufficient size has been previously allocated for the variables on the target by using a FREE_IF(.FALSE.) clause on an earlier offload.

  The FREE_IF modifier specifies a Boolean condition that controls whether to deallocate the memory allocated for the allocatable variables in an IN clause. If the expression evaluates to true, the memory pointed to by each variable listed in the clause is deallocated. If the condition evaluates to false, no action is taken on the memory pointed to by the variables in the list. A subsequent clause will be able to reuse the allocated memory (data persistence).

  For more information, see Managing Memory Allocation for Pointer Variables.

• ALIGN (expression)

  where the value of expression should be a power of two.

  This modifier applies to pointer variables and requests the specified minimum alignment for pointer data allocated on the target.

• ALLOC (array-subscript-list)

  where array-subscript-list is a list of array section triplets that specifies a set of elements of an array that need allocation. The array-subscript-list takes the following form:

  start-element : end-element [ : stride] [ , start-element : end-element [ : stride] ]…

  This modifier can only be used in IN and OUT clauses and only one identifier must be listed in the clause. A one to one correspondence is established between the identifier in the IN or OUT clause and the base variable that will be allocated with array-subscript-list dimensions.

  When ALLOC is specified, the allocation on the target is the same shape as array-subscript-list. The variable being transferred or allocated must be the same variable used in the ALLOC modifier (identifier or into-identifier). Only unit strides are allowed in array-subscript-list. When array-subscript-list has rank greater than one, the second and subsequent subscript triplet must specify all elements at that dimension. Therefore, array-subscript-list must describe an array that is simply contiguous. (See CONTIGUOUS.)

  Data is transferred into that portion of the array specified by the IN or OUT clauses. Therefore, memory allocation and the data transfer can use separate array slice references.

  When the lower bound of the first dimension of array-subscript-list in the ALLOC is greater than the lower bound of the first dimension of identifier, then the memory allocation begins with that element. The memory below the lower bound is unallocated and should not be referenced by the program. This allows a smaller section of the array to be transferred to the target without requiring that the entire array be allocated.

  For more information, see Allocating Memory for Parts of Arrays.

• INTO (into-identifier)

  where into-identifier is a variable, a subscripted variable, an array slice, or a component reference with the same form, rank, dimensions, and kind type parameters as the identifier in the clause.

  This modifier can only be used in IN and OUT clauses and only one identifier must be listed in the clause. When INTO is specified, data can be transferred from one variable on the CPU to another on the target, and vice versa. This establishes a one to one correspondence between a single source variable and a single destination variable.

  You can specify ALLOC, ALLOC_IF, and FREE_IF modifiers along with the INTO modifier.

  When INTO is used in an IN clause, data is copied from the CPU object identifier to the target object into-identifier. If the ALLOC_IF, FREE_IF, or ALLOC modifier is specified, it applies only to the identifier in the IN clause.

  When INTO is used in an OUT clause, data is copied from the target object into-identifier to the CPU object identifier. If the ALLOC_IF, FREE_IF, or ALLOC modifier is specified, it applies only to the identifier in the OUT expression.

  When this modifier is used, the source expression generates a stream of elements to be copied into the memory range specified by the INTO expression.

  If overlap occurs between the source and destination variables, it causes undefined behavior (although with disjoint memories it will work as expected). No ordering can be assumed between transfers from different IN or OUT clauses.

  For more information, see Moving Data from One Variable to Another.