{"data":{"id":"10.48550/arxiv.2307.05617","type":"dois","attributes":{"doi":"10.48550/arxiv.2307.05617","prefix":"10.48550","suffix":"arxiv.2307.05617","identifiers":[{"identifier":"2307.05617","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2307.05617"}],"creators":[{"name":"Wang, Chenglong","nameType":"Personal","givenName":"Chenglong","familyName":"Wang","affiliation":[],"nameIdentifiers":[]},{"name":"Li, Dexuan","nameType":"Personal","givenName":"Dexuan","familyName":"Li","affiliation":[],"nameIdentifiers":[]},{"name":"Wang, Sucheng","nameType":"Personal","givenName":"Sucheng","familyName":"Wang","affiliation":[],"nameIdentifiers":[]},{"name":"Zhang, Chengxiu","nameType":"Personal","givenName":"Chengxiu","familyName":"Zhang","affiliation":[],"nameIdentifiers":[]},{"name":"Wang, Yida","nameType":"Personal","givenName":"Yida","familyName":"Wang","affiliation":[],"nameIdentifiers":[]},{"name":"Liu, Yun","nameType":"Personal","givenName":"Yun","familyName":"Liu","affiliation":[],"nameIdentifiers":[]},{"name":"Yang, Guang","nameType":"Personal","givenName":"Guang","familyName":"Yang","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"$\\mathrm{SAM^{Med}}$: A medical image annotation framework based on large vision model"}],"publisher":"arXiv","container":{},"publicationYear":2023,"subjects":[{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2023-07-11T03:00:22Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2023-07-13T00:04:21Z","dateType":"Updated","dateInformation":"v1"},{"date":"2023-09-18T02:19:52Z","dateType":"Submitted","dateInformation":"v2"},{"date":"2023-09-20T00:00:22Z","dateType":"Updated","dateInformation":"v2"},{"date":"2023-07","dateType":"Available","dateInformation":"v1"},{"date":"2023","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"2","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Recently, large vision model, Segment Anything Model (SAM), has revolutionized the computer vision field, especially for image segmentation. SAM presented a new promptable segmentation paradigm that exhibit its remarkable zero-shot generalization ability. An extensive researches have explore the potential and limits of SAM in various downstream tasks. In this study, we presents $\\mathrm{SAM^{Med}}$, an enhanced framework for medical image annotation that leverages the capabilities of SAM. $\\mathrm{SAM^{Med}}$ framework consisted of two submodules, namely $\\mathrm{SAM^{assist}}$ and $\\mathrm{SAM^{auto}}$. The $\\mathrm{SAM^{assist}}$ demonstrates the generalization ability of SAM to the downstream medical segmentation task using the prompt-learning approach. Results show a significant improvement in segmentation accuracy with only approximately 5 input points. The $\\mathrm{SAM^{auto}}$ model aims to accelerate the annotation process by automatically generating input prompts. The proposed SAP-Net model achieves superior segmentation performance with only five annotated slices, achieving an average Dice coefficient of 0.80 and 0.82 for kidney and liver segmentation, respectively. Overall, $\\mathrm{SAM^{Med}}$ demonstrates promising results in medical image annotation. These findings highlight the potential of leveraging large-scale vision models in medical image annotation tasks.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMzA3LjA1NjE3PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjMwNy4wNTYxNzwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XYW5nLCBDaGVuZ2xvbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkNoZW5nbG9uZzwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5XYW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkxpLCBEZXh1YW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkRleHVhbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5MaTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XYW5nLCBTdWNoZW5nPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5TdWNoZW5nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPldhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WmhhbmcsIENoZW5neGl1PC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5DaGVuZ3hpdTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5aaGFuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XYW5nLCBZaWRhPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5ZaWRhPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPldhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+TGl1LCBZdW48L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPll1bjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5MaXU8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WWFuZywgR3Vhbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkd1YW5nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPllhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPiRcbWF0aHJte1NBTV57TWVkfX0kOiBBIG1lZGljYWwgaW1hZ2UgYW5ub3RhdGlvbiBmcmFtZXdvcmsgYmFzZWQgb24gbGFyZ2UgdmlzaW9uIG1vZGVsPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDIzPC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+Q29tcHV0ZXIgVmlzaW9uIGFuZCBQYXR0ZXJuIFJlY29nbml0aW9uIChjcy5DVik8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBDb21wdXRlciBhbmQgaW5mb3JtYXRpb24gc2NpZW5jZXM8L3N1YmplY3Q+CiAgPC9zdWJqZWN0cz4KICA8ZGF0ZXM+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iU3VibWl0dGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIzLTA3LTExVDAzOjAwOjIyWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJVcGRhdGVkIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDIzLTA3LTEzVDAwOjA0OjIxWjwvZGF0ZT4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjIiPjIwMjMtMDktMThUMDI6MTk6NTJaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjIiPjIwMjMtMDktMjBUMDA6MDA6MjJaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IkF2YWlsYWJsZSIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMy0wNzwvZGF0ZT4KICA8L2RhdGVzPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iUHJlcHJpbnQiPkFydGljbGU8L3Jlc291cmNlVHlwZT4KICA8dmVyc2lvbj4yPC92ZXJzaW9uPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHA6Ly9hcnhpdi5vcmcvbGljZW5zZXMvbm9uZXhjbHVzaXZlLWRpc3RyaWIvMS4wLyI+YXJYaXYub3JnIHBlcnBldHVhbCwgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+UmVjZW50bHksIGxhcmdlIHZpc2lvbiBtb2RlbCwgU2VnbWVudCBBbnl0aGluZyBNb2RlbCAoU0FNKSwgaGFzIHJldm9sdXRpb25pemVkIHRoZSBjb21wdXRlciB2aXNpb24gZmllbGQsIGVzcGVjaWFsbHkgZm9yIGltYWdlIHNlZ21lbnRhdGlvbi4gU0FNIHByZXNlbnRlZCBhIG5ldyBwcm9tcHRhYmxlIHNlZ21lbnRhdGlvbiBwYXJhZGlnbSB0aGF0IGV4aGliaXQgaXRzIHJlbWFya2FibGUgemVyby1zaG90IGdlbmVyYWxpemF0aW9uIGFiaWxpdHkuIEFuIGV4dGVuc2l2ZSByZXNlYXJjaGVzIGhhdmUgZXhwbG9yZSB0aGUgcG90ZW50aWFsIGFuZCBsaW1pdHMgb2YgU0FNIGluIHZhcmlvdXMgZG93bnN0cmVhbSB0YXNrcy4gSW4gdGhpcyBzdHVkeSwgd2UgcHJlc2VudHMgJFxtYXRocm17U0FNXntNZWR9fSQsIGFuIGVuaGFuY2VkIGZyYW1ld29yayBmb3IgbWVkaWNhbCBpbWFnZSBhbm5vdGF0aW9uIHRoYXQgbGV2ZXJhZ2VzIHRoZSBjYXBhYmlsaXRpZXMgb2YgU0FNLiAkXG1hdGhybXtTQU1ee01lZH19JCBmcmFtZXdvcmsgY29uc2lzdGVkIG9mIHR3byBzdWJtb2R1bGVzLCBuYW1lbHkgJFxtYXRocm17U0FNXnthc3Npc3R9fSQgYW5kICRcbWF0aHJte1NBTV57YXV0b319JC4gVGhlICRcbWF0aHJte1NBTV57YXNzaXN0fX0kIGRlbW9uc3RyYXRlcyB0aGUgZ2VuZXJhbGl6YXRpb24gYWJpbGl0eSBvZiBTQU0gdG8gdGhlIGRvd25zdHJlYW0gbWVkaWNhbCBzZWdtZW50YXRpb24gdGFzayB1c2luZyB0aGUgcHJvbXB0LWxlYXJuaW5nIGFwcHJvYWNoLiBSZXN1bHRzIHNob3cgYSBzaWduaWZpY2FudCBpbXByb3ZlbWVudCBpbiBzZWdtZW50YXRpb24gYWNjdXJhY3kgd2l0aCBvbmx5IGFwcHJveGltYXRlbHkgNSBpbnB1dCBwb2ludHMuIFRoZSAkXG1hdGhybXtTQU1ee2F1dG99fSQgbW9kZWwgYWltcyB0byBhY2NlbGVyYXRlIHRoZSBhbm5vdGF0aW9uIHByb2Nlc3MgYnkgYXV0b21hdGljYWxseSBnZW5lcmF0aW5nIGlucHV0IHByb21wdHMuIFRoZSBwcm9wb3NlZCBTQVAtTmV0IG1vZGVsIGFjaGlldmVzIHN1cGVyaW9yIHNlZ21lbnRhdGlvbiBwZXJmb3JtYW5jZSB3aXRoIG9ubHkgZml2ZSBhbm5vdGF0ZWQgc2xpY2VzLCBhY2hpZXZpbmcgYW4gYXZlcmFnZSBEaWNlIGNvZWZmaWNpZW50IG9mIDAuODAgYW5kIDAuODIgZm9yIGtpZG5leSBhbmQgbGl2ZXIgc2VnbWVudGF0aW9uLCByZXNwZWN0aXZlbHkuIE92ZXJhbGwsICRcbWF0aHJte1NBTV57TWVkfX0kIGRlbW9uc3RyYXRlcyBwcm9taXNpbmcgcmVzdWx0cyBpbiBtZWRpY2FsIGltYWdlIGFubm90YXRpb24uIFRoZXNlIGZpbmRpbmdzIGhpZ2hsaWdodCB0aGUgcG90ZW50aWFsIG9mIGxldmVyYWdpbmcgbGFyZ2Utc2NhbGUgdmlzaW9uIG1vZGVscyBpbiBtZWRpY2FsIGltYWdlIGFubm90YXRpb24gdGFza3MuPC9kZXNjcmlwdGlvbj4KICA8L2Rlc2NyaXB0aW9ucz4KPC9yZXNvdXJjZT4=","url":"https://arxiv.org/abs/2307.05617","contentUrl":null,"metadataVersion":1,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2023-07-13T01:13:49.000Z","registered":"2023-07-13T01:13:50.000Z","published":"2023","updated":"2023-09-20T01:25:45.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2307.05617","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}