Large model inference

[HamidShojanazeri]

Description

Adding PiPPy large model inference with HF example

Note waiting for PiPPY binaries later this week(04/10) to update the dev requirements.

Also this PR moves all our large model related examples, deepspeed, accelerate under example/ large_model folder

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• [X ] New feature (non-breaking change which adds functionality)
• [X ] This change requires a documentation update

Feature/Issue validation/testing

Please describe the Unit or Integration tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

• Test A
  Logs for regression tests
  https://drive.google.com/file/d/1k7iBydhIv2MpBXmwDuaPkFuerXige5Tm/view?usp=share_link

• Test B
  Logs for Test B

Checklist:

• Did you have fun?
• Have you added tests that prove your fix is effective or that this feature works?
• Has code been commented, particularly in hard-to-understand areas?
• Have you made corresponding changes to the documentation?

[codecov]

Codecov Report

Merging #2215 (c9245b1) into master (044bbc1) will decrease coverage by 1.17%.
The diff coverage is 0.00%.

❗ Current head c9245b1 differs from pull request most recent head 6efa20c. Consider uploading reports for the commit 6efa20c to get more accurate results

@@            Coverage Diff             @@
##           master    #2215      +/-   ##
==========================================
- Coverage   71.47%   70.31%   -1.17%     
==========================================
  Files          73       75       +2     
  Lines        3341     3392      +51     
  Branches       57       57              
==========================================
- Hits         2388     2385       -3     
- Misses        950     1004      +54     
  Partials        3        3              

Impacted Files	Coverage Δ
ts/handler_utils/distributed/pt_pippy.py	0.00% <0.00%> (ø)
ts/torch_handler/distributed/base_pippy_handler.py	0.00% <0.00%> (ø)

... and 1 file with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[lxning]

I added comments for Huggingface_pippy. They can apply to the Hugingfac_accelerate and Deepspeed_mii

[lxning]

could move this readme under dir Huggingface_pippy since this doc is about pippy?

Can we add common instruction/steps in this doc?

[lxning]

yes

[msaroufim]

LGTM, please just make sure lint jobs are green and we can merge

[HamidShojanazeri]

Thanks @msaroufim , sure will address the failing spell checks and lints