Skip to content

Add the link to the QA model to huggingface #122

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

espoirMur
Copy link

@espoirMur espoirMur commented Feb 17, 2024

I have converted the QA checkpoint model to a Huggingface model! Please, have a look and test If it works.

The full model is here: https://huggingface.co/espoir/BioGPT-Large-QA-PubMedQA!

Canvas:

The main prompt model was outputting a sequence of words learned1, learned2, ... learned9 before output the answer of the question! I checked this my be due to the way prompt was set up during training.

Before adding the model to huggingface and to make it work I have added 9 extras words to the embedding layers to accommodate the fairseq model weight.

With that below are the difference output of the two models:

FairseqOne:


('Do mitochondria play a role in remodelling lace plant leaves during '
 'programmed cell death? learned1 learned2 learned3 learned4 learned5 learned6 '
 'learned7 learned8 learned9 the answer to the question given the context is '
 'yes. context: Programmed cell death (PCD) is the regulated death of cells '
 'within an organism. The lace plant (Aponogeton madagascariensis) produces '
 'perforations in its leaves through PCD. The leaves of the plant consist of a '
 'latticework of longitudinal and transverse veins enclosing areoles. PCD '
 'occurs in the cells at the center of these areoles and progresses outwards, '
 'stopping approximately five cells from the vasculature. The role of '
 'mitochondria during PCD has been recognized in animals; however, it has been '
 'less studied during PCD in plants. The following paper elucidates the role '
 'of mitochondrial dynamics during developmentally regulated PCD in vivo in A. '
 'madagascariensis. A single areole within a window stage leaf (PCD is '
 'occurring) was divided into three areas based on the progression of PCD; '
 'cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), '
 'and cells in late stages of PCD (LPCD). Window stage leaves were stained '
 'with the mitochondrial dye MitoTracker Red CMXRos and examined. '
 'Mitochondrial dynamics were delineated into four categories (M1-M4) based on '
 'characteristics including distribution, motility, and membrane potential '
 '(ΔΨm). Chloroplasts and transvacuolar strands were also examined using live '
 'cell imaging. Chloroplasts were examined for signs of swelling and [/](https://file+.vscode-resource.vscode-cdn.net/) or '
 'membrane potential loss. A TUNEL assay was performed to detect fragmented '
 'nDNA. Chloroplasts in cells undergoing PCD were also examined using live '
 'cell imaging. The role of mitochondrial permeability transition pore (PTP) '
 'formation during PCD was examined using cyclosporine A (CsA). A single '
 'areole within a window stage leaf (PCD is occurring) was divided into three '
 'areas based on the progression of PCD; cells that will not undergo PCD '
 '(NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD '
 '(LPCD). Mitochondrial dynamics were delineated into four categories (M1-M4) '
 'based on characteristics including distribution, motility, and ΔΨm. '
 'Chloroplasts in cells undergoing PCD were also examined using live cell '
 'imaging. Mitochondrial dynamics were characterized into four categories '
 '(M1-M4) based on characteristics including swelling and [/](https://file+.vscode-resource.vscode-cdn.net/) or ΔΨm. '
 'Chloroplasts in cells undergoing PCD were also examined using live cell '
 'imaging. CsA treatment resulted in mitochondrial permeability transition '
 'pore (PTP) formation and cell death. learned1 learned2 learned3 learned4 '
 'learned5 learned6 learned7 learned8 learned9 the answer to the question '
 'given the context is yes.'

The one with hugginface:

('Question: Do mitochondria play a role in remodelling lace plant leaves '
 'during programmed cell death? Context: Programmed cell death (PCD) is the '
 'regulated death of cells within an organism. The lace plant (Aponogeton '
 'madagascariensis) produces perforations in its leaves through PCD. The '
 'leaves of the plant consist of a latticework of longitudinal and transverse '
 'veins enclosing areoles. PCD occurs in the cells at the center of these '
 'areoles and progresses outwards, stopping approximately five cells from the '
 'vasculature. The role of mitochondria during PCD has been recognized in '
 'animals; however, it has been less studied during PCD in plants. The '
 'following paper elucidates the role of mitochondrial dynamics during '
 'developmentally regulated PCD in vivo in A. madagascariensis. A single '
 'areole within a window stage leaf (PCD is occurring) was divided into three '
 'areas based on the progression of PCD; cells that will not undergo PCD '
 '(NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD '
 '(LPCD). Window stage leaves were stained with the mitochondrial dye '
 'MitoTracker Red CMXRos and examined. Mitochondrial dynamics were delineated '
 'into four categories (M1-M4) based on characteristics including '
 'distribution, motility, and membrane potential (ΔΨm). A TUNEL assay showed '
 'fragmented nDNA in a gradient over these mitochondrial stages. Chloroplasts '
 'and transvacuolar strands were also examined using live cell imaging. The '
 'possible importance of mitochondrial permeability transition pore (PTP) '
 'formation during PCD was indirectly examined via in vivo cyclosporine A '
 '(CsA) treatment. This treatment resulted in lace plant leaves with a '
 'significantly lower number of perforations compared to controls, and that '
 'displayed mitochondrial dynamics similar to that of non-PCD cells. '
 '<unk><unk><unk><unk><unk><unk><unk><unk><unk>the answer to the question '
 'given the context is yes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant