Implement Delta distribution?

[fritzo]

Pyro has many internal uses for the Delta (aka degenerate distribution). It is unclear whether Delta belongs in PyTorch.

[jwvdm]

I think that this is the kind of thing that one might as well include – it is very easy to implement and doesn't get in the way of anything.