Skip to content

Commit 014f30f

Browse files
rootcqulilujia
authored andcommitted
Fix the typos of FusedRMSNorm doc
1 parent 73375b3 commit 014f30f

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

apex/normalization/fused_layer_norm.py

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -746,7 +746,7 @@ class FusedLayerNorm(torch.nn.Module):
746746
eps: a value added to the denominator for numerical stability. Default: 1e-5
747747
elementwise_affine: a boolean value that when set to ``True``, this module
748748
has learnable per-element affine parameters initialized to ones (for weights)
749-
and zeros (for biases). Default: ``True``.
749+
and zeros (for biases). Default: :obj:`True`.
750750
751751
Shape:
752752
- Input: :math:`(N, *)`
@@ -844,8 +844,7 @@ class FusedRMSNorm(torch.nn.Module):
844844
normalize over the last dimension which is expected to be of that specific size.
845845
eps: a value added to the denominator for numerical stability. Default: 1e-5
846846
elementwise_affine: a boolean value that when set to ``True``, this module
847-
has learnable per-element affine parameters initialized to ones (for weights)
848-
and zeros (for biases). Default: ``True``.
847+
has learnable per-element affine parameters initialized to ones for weights. Default: :obj:`True`.
849848
850849
Shape:
851850
- Input: :math:`(N, *)`

0 commit comments

Comments
 (0)