Shortcuts

apply_func

Functions

apply_to_collection

Recursively applies a function to all elements of a certain dtype.

apply_to_collections

Zips two collections and applies a function to their items of a certain dtype.

convert_to_tensors

rtype

Any

from_numpy

rtype

Tensor

move_data_to_device

Transfers a collection of data to the given device.

to_dtype_tensor

rtype

Tensor

Classes

TransferableDataType

A custom type for data that can be moved to a torch device via .to(...).

Utilities used for collections.

class pytorch_lightning.utilities.apply_func.TransferableDataType[source]

Bases: abc.ABC

A custom type for data that can be moved to a torch device via .to(...).

Example

>>> isinstance(dict, TransferableDataType)
False
>>> isinstance(torch.rand(2, 3), TransferableDataType)
True
>>> class CustomObject:
...     def __init__(self):
...         self.x = torch.rand(2, 2)
...     def to(self, device):
...         self.x = self.x.to(device)
...         return self
>>> isinstance(CustomObject(), TransferableDataType)
True
pytorch_lightning.utilities.apply_func.apply_to_collection(data, dtype, function, *args, wrong_dtype=None, include_none=True, **kwargs)[source]

Recursively applies a function to all elements of a certain dtype.

Parameters
  • data (Any) – the collection to apply the function to

  • dtype (Union[type, Any, Tuple[Union[type, Any]]]) – the given function will be applied to all elements of this dtype

  • function (Callable) – the function to apply

  • *args – positional arguments (will be forwarded to calls of function)

  • wrong_dtype (Union[type, Tuple[type], None]) – the given function won’t be applied if this type is specified and the given collections is of the wrong_dtype even if it is of type dtype

  • include_none (bool) – Whether to include an element if the output of function is None.

  • **kwargs – keyword arguments (will be forwarded to calls of function)

Return type

Any

Returns

The resulting collection

pytorch_lightning.utilities.apply_func.apply_to_collections(data1, data2, dtype, function, *args, wrong_dtype=None, **kwargs)[source]

Zips two collections and applies a function to their items of a certain dtype.

Parameters
  • data1 (Optional[Any]) – The first collection

  • data2 (Optional[Any]) – The second collection

  • dtype (Union[type, Any, Tuple[Union[type, Any]]]) – the given function will be applied to all elements of this dtype

  • function (Callable) – the function to apply

  • *args – positional arguments (will be forwarded to calls of function)

  • wrong_dtype (Union[type, Tuple[type], None]) – the given function won’t be applied if this type is specified and the given collections is of the wrong_dtype even if it is of type dtype

  • **kwargs – keyword arguments (will be forwarded to calls of function)

Return type

Any

Returns

The resulting collection

Raises

AssertionError – If sequence collections have different data sizes.

pytorch_lightning.utilities.apply_func.move_data_to_device(batch, device)[source]

Transfers a collection of data to the given device. Any object that defines a method to(device) will be moved and all other objects in the collection will be left untouched.

Parameters
  • batch (Any) – A tensor or collection of tensors or anything that has a method .to(...). See apply_to_collection() for a list of supported collection types.

  • device (Union[str, device]) – The device to which the data should be moved

Return type

Any

Returns

the same collection but with all contained tensors residing on the new device.