{"data":{"id":"10.48550/arxiv.2308.05365","type":"dois","attributes":{"doi":"10.48550/arxiv.2308.05365","prefix":"10.48550","suffix":"arxiv.2308.05365","identifiers":[{"identifier":"2308.05365","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2308.05365"}],"creators":[{"name":"Cui, Jiaqi","nameType":"Personal","givenName":"Jiaqi","familyName":"Cui","affiliation":[],"nameIdentifiers":[]},{"name":"Zeng, Pinxian","nameType":"Personal","givenName":"Pinxian","familyName":"Zeng","affiliation":[],"nameIdentifiers":[]},{"name":"Zeng, Xinyi","nameType":"Personal","givenName":"Xinyi","familyName":"Zeng","affiliation":[],"nameIdentifiers":[]},{"name":"Wang, Peng","nameType":"Personal","givenName":"Peng","familyName":"Wang","affiliation":[],"nameIdentifiers":[]},{"name":"Wu, Xi","nameType":"Personal","givenName":"Xi","familyName":"Wu","affiliation":[],"nameIdentifiers":[]},{"name":"Zhou, Jiliu","nameType":"Personal","givenName":"Jiliu","familyName":"Zhou","affiliation":[],"nameIdentifiers":[]},{"name":"Wang, Yan","nameType":"Personal","givenName":"Yan","familyName":"Wang","affiliation":[],"nameIdentifiers":[]},{"name":"Shen, Dinggang","nameType":"Personal","givenName":"Dinggang","familyName":"Shen","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"TriDo-Former: A Triple-Domain Transformer for Direct PET Reconstruction from Low-Dose Sinograms"}],"publisher":"arXiv","container":{},"publicationYear":2023,"subjects":[{"lang":"en","subject":"Image and Video Processing (eess.IV)","subjectScheme":"arXiv"},{"lang":"en","subject":"Computer Vision and Pattern Recognition (cs.CV)","subjectScheme":"arXiv"},{"subject":"FOS: Electrical engineering, electronic engineering, information engineering","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Electrical engineering, electronic engineering, information engineering","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"},{"subject":"FOS: Computer and information sciences","schemeUri":"http://www.oecd.org/science/inno/38235147.pdf","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2023-08-10T06:20:00Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2023-08-11T00:11:23Z","dateType":"Updated","dateInformation":"v1"},{"date":"2023-08","dateType":"Available","dateInformation":"v1"},{"date":"2023","dateType":"Issued"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"To obtain high-quality positron emission tomography (PET) images while minimizing radiation exposure, various methods have been proposed for reconstructing standard-dose PET (SPET) images from low-dose PET (LPET) sinograms directly. However, current methods often neglect boundaries during sinogram-to-image reconstruction, resulting in high-frequency distortion in the frequency domain and diminished or fuzzy edges in the reconstructed images. Furthermore, the convolutional architectures, which are commonly used, lack the ability to model long-range non-local interactions, potentially leading to inaccurate representations of global structures. To alleviate these problems, we propose a transformer-based model that unites triple domains of sinogram, image, and frequency for direct PET reconstruction, namely TriDo-Former. Specifically, the TriDo-Former consists of two cascaded networks, i.e., a sinogram enhancement transformer (SE-Former) for denoising the input LPET sinograms and a spatial-spectral reconstruction transformer (SSR-Former) for reconstructing SPET images from the denoised sinograms. Different from the vanilla transformer that splits an image into 2D patches, based specifically on the PET imaging mechanism, our SE-Former divides the sinogram into 1D projection view angles to maintain its inner-structure while denoising, preventing the noise in the sinogram from prorogating into the image domain. Moreover, to mitigate high-frequency distortion and improve reconstruction details, we integrate global frequency parsers (GFPs) into SSR-Former. The GFP serves as a learnable frequency filter that globally adjusts the frequency components in the frequency domain, enforcing the network to restore high-frequency details resembling real SPET images. Validations on a clinical dataset demonstrate that our TriDo-Former outperforms the state-of-the-art methods qualitatively and quantitatively.","descriptionType":"Abstract"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yMzA4LjA1MzY1PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjMwOC4wNTM2NTwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5DdWksIEppYXFpPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5KaWFxaTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5DdWk8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WmVuZywgUGlueGlhbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+UGlueGlhbjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5aZW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlplbmcsIFhpbnlpPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5YaW55aTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5aZW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPldhbmcsIFBlbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlBlbmc8L2dpdmVuTmFtZT4KICAgICAgPGZhbWlseU5hbWU+V2FuZzwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5XdSwgWGk8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPlhpPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPld1PC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPlpob3UsIEppbGl1PC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5KaWxpdTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5aaG91PC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPldhbmcsIFlhbjwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+WWFuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPldhbmc8L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+U2hlbiwgRGluZ2dhbmc8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkRpbmdnYW5nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlNoZW48L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgPC9jcmVhdG9ycz4KICA8dGl0bGVzPgogICAgPHRpdGxlPlRyaURvLUZvcm1lcjogQSBUcmlwbGUtRG9tYWluIFRyYW5zZm9ybWVyIGZvciBEaXJlY3QgUEVUIFJlY29uc3RydWN0aW9uIGZyb20gTG93LURvc2UgU2lub2dyYW1zPC90aXRsZT4KICA8L3RpdGxlcz4KICA8cHVibGlzaGVyPmFyWGl2PC9wdWJsaXNoZXI+CiAgPHB1YmxpY2F0aW9uWWVhcj4yMDIzPC9wdWJsaWNhdGlvblllYXI+CiAgPHN1YmplY3RzPgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+SW1hZ2UgYW5kIFZpZGVvIFByb2Nlc3NpbmcgKGVlc3MuSVYpPC9zdWJqZWN0PgogICAgPHN1YmplY3QgeG1sOmxhbmc9ImVuIiBzdWJqZWN0U2NoZW1lPSJhclhpdiI+Q29tcHV0ZXIgVmlzaW9uIGFuZCBQYXR0ZXJuIFJlY29nbml0aW9uIChjcy5DVik8L3N1YmplY3Q+CiAgICA8c3ViamVjdCBzdWJqZWN0U2NoZW1lPSJGaWVsZHMgb2YgU2NpZW5jZSBhbmQgVGVjaG5vbG9neSAoRk9TKSI+Rk9TOiBFbGVjdHJpY2FsIGVuZ2luZWVyaW5nLCBlbGVjdHJvbmljIGVuZ2luZWVyaW5nLCBpbmZvcm1hdGlvbiBlbmdpbmVlcmluZzwvc3ViamVjdD4KICAgIDxzdWJqZWN0IHN1YmplY3RTY2hlbWU9IkZpZWxkcyBvZiBTY2llbmNlIGFuZCBUZWNobm9sb2d5IChGT1MpIj5GT1M6IENvbXB1dGVyIGFuZCBpbmZvcm1hdGlvbiBzY2llbmNlczwvc3ViamVjdD4KICA8L3N1YmplY3RzPgogIDxkYXRlcz4KICAgIDxkYXRlIGRhdGVUeXBlPSJTdWJtaXR0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjMtMDgtMTBUMDY6MjA6MDBaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IlVwZGF0ZWQiIGRhdGVJbmZvcm1hdGlvbj0idjEiPjIwMjMtMDgtMTFUMDA6MTE6MjNaPC9kYXRlPgogICAgPGRhdGUgZGF0ZVR5cGU9IkF2YWlsYWJsZSIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyMy0wODwvZGF0ZT4KICA8L2RhdGVzPgogIDxyZXNvdXJjZVR5cGUgcmVzb3VyY2VUeXBlR2VuZXJhbD0iUHJlcHJpbnQiPkFydGljbGU8L3Jlc291cmNlVHlwZT4KICA8dmVyc2lvbj4xPC92ZXJzaW9uPgogIDxyaWdodHNMaXN0PgogICAgPHJpZ2h0cyByaWdodHNVUkk9Imh0dHA6Ly9hcnhpdi5vcmcvbGljZW5zZXMvbm9uZXhjbHVzaXZlLWRpc3RyaWIvMS4wLyI+YXJYaXYub3JnIHBlcnBldHVhbCwgbm9uLWV4Y2x1c2l2ZSBsaWNlbnNlPC9yaWdodHM+CiAgPC9yaWdodHNMaXN0PgogIDxkZXNjcmlwdGlvbnM+CiAgICA8ZGVzY3JpcHRpb24gZGVzY3JpcHRpb25UeXBlPSJBYnN0cmFjdCI+VG8gb2J0YWluIGhpZ2gtcXVhbGl0eSBwb3NpdHJvbiBlbWlzc2lvbiB0b21vZ3JhcGh5IChQRVQpIGltYWdlcyB3aGlsZSBtaW5pbWl6aW5nIHJhZGlhdGlvbiBleHBvc3VyZSwgdmFyaW91cyBtZXRob2RzIGhhdmUgYmVlbiBwcm9wb3NlZCBmb3IgcmVjb25zdHJ1Y3Rpbmcgc3RhbmRhcmQtZG9zZSBQRVQgKFNQRVQpIGltYWdlcyBmcm9tIGxvdy1kb3NlIFBFVCAoTFBFVCkgc2lub2dyYW1zIGRpcmVjdGx5LiBIb3dldmVyLCBjdXJyZW50IG1ldGhvZHMgb2Z0ZW4gbmVnbGVjdCBib3VuZGFyaWVzIGR1cmluZyBzaW5vZ3JhbS10by1pbWFnZSByZWNvbnN0cnVjdGlvbiwgcmVzdWx0aW5nIGluIGhpZ2gtZnJlcXVlbmN5IGRpc3RvcnRpb24gaW4gdGhlIGZyZXF1ZW5jeSBkb21haW4gYW5kIGRpbWluaXNoZWQgb3IgZnV6enkgZWRnZXMgaW4gdGhlIHJlY29uc3RydWN0ZWQgaW1hZ2VzLiBGdXJ0aGVybW9yZSwgdGhlIGNvbnZvbHV0aW9uYWwgYXJjaGl0ZWN0dXJlcywgd2hpY2ggYXJlIGNvbW1vbmx5IHVzZWQsIGxhY2sgdGhlIGFiaWxpdHkgdG8gbW9kZWwgbG9uZy1yYW5nZSBub24tbG9jYWwgaW50ZXJhY3Rpb25zLCBwb3RlbnRpYWxseSBsZWFkaW5nIHRvIGluYWNjdXJhdGUgcmVwcmVzZW50YXRpb25zIG9mIGdsb2JhbCBzdHJ1Y3R1cmVzLiBUbyBhbGxldmlhdGUgdGhlc2UgcHJvYmxlbXMsIHdlIHByb3Bvc2UgYSB0cmFuc2Zvcm1lci1iYXNlZCBtb2RlbCB0aGF0IHVuaXRlcyB0cmlwbGUgZG9tYWlucyBvZiBzaW5vZ3JhbSwgaW1hZ2UsIGFuZCBmcmVxdWVuY3kgZm9yIGRpcmVjdCBQRVQgcmVjb25zdHJ1Y3Rpb24sIG5hbWVseSBUcmlEby1Gb3JtZXIuIFNwZWNpZmljYWxseSwgdGhlIFRyaURvLUZvcm1lciBjb25zaXN0cyBvZiB0d28gY2FzY2FkZWQgbmV0d29ya3MsIGkuZS4sIGEgc2lub2dyYW0gZW5oYW5jZW1lbnQgdHJhbnNmb3JtZXIgKFNFLUZvcm1lcikgZm9yIGRlbm9pc2luZyB0aGUgaW5wdXQgTFBFVCBzaW5vZ3JhbXMgYW5kIGEgc3BhdGlhbC1zcGVjdHJhbCByZWNvbnN0cnVjdGlvbiB0cmFuc2Zvcm1lciAoU1NSLUZvcm1lcikgZm9yIHJlY29uc3RydWN0aW5nIFNQRVQgaW1hZ2VzIGZyb20gdGhlIGRlbm9pc2VkIHNpbm9ncmFtcy4gRGlmZmVyZW50IGZyb20gdGhlIHZhbmlsbGEgdHJhbnNmb3JtZXIgdGhhdCBzcGxpdHMgYW4gaW1hZ2UgaW50byAyRCBwYXRjaGVzLCBiYXNlZCBzcGVjaWZpY2FsbHkgb24gdGhlIFBFVCBpbWFnaW5nIG1lY2hhbmlzbSwgb3VyIFNFLUZvcm1lciBkaXZpZGVzIHRoZSBzaW5vZ3JhbSBpbnRvIDFEIHByb2plY3Rpb24gdmlldyBhbmdsZXMgdG8gbWFpbnRhaW4gaXRzIGlubmVyLXN0cnVjdHVyZSB3aGlsZSBkZW5vaXNpbmcsIHByZXZlbnRpbmcgdGhlIG5vaXNlIGluIHRoZSBzaW5vZ3JhbSBmcm9tIHByb3JvZ2F0aW5nIGludG8gdGhlIGltYWdlIGRvbWFpbi4gTW9yZW92ZXIsIHRvIG1pdGlnYXRlIGhpZ2gtZnJlcXVlbmN5IGRpc3RvcnRpb24gYW5kIGltcHJvdmUgcmVjb25zdHJ1Y3Rpb24gZGV0YWlscywgd2UgaW50ZWdyYXRlIGdsb2JhbCBmcmVxdWVuY3kgcGFyc2VycyAoR0ZQcykgaW50byBTU1ItRm9ybWVyLiBUaGUgR0ZQIHNlcnZlcyBhcyBhIGxlYXJuYWJsZSBmcmVxdWVuY3kgZmlsdGVyIHRoYXQgZ2xvYmFsbHkgYWRqdXN0cyB0aGUgZnJlcXVlbmN5IGNvbXBvbmVudHMgaW4gdGhlIGZyZXF1ZW5jeSBkb21haW4sIGVuZm9yY2luZyB0aGUgbmV0d29yayB0byByZXN0b3JlIGhpZ2gtZnJlcXVlbmN5IGRldGFpbHMgcmVzZW1ibGluZyByZWFsIFNQRVQgaW1hZ2VzLiBWYWxpZGF0aW9ucyBvbiBhIGNsaW5pY2FsIGRhdGFzZXQgZGVtb25zdHJhdGUgdGhhdCBvdXIgVHJpRG8tRm9ybWVyIG91dHBlcmZvcm1zIHRoZSBzdGF0ZS1vZi10aGUtYXJ0IG1ldGhvZHMgcXVhbGl0YXRpdmVseSBhbmQgcXVhbnRpdGF0aXZlbHkuPC9kZXNjcmlwdGlvbj4KICA8L2Rlc2NyaXB0aW9ucz4KPC9yZXNvdXJjZT4=","url":"https://arxiv.org/abs/2308.05365","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2023-08-11T01:07:18.000Z","registered":"2023-08-11T01:07:18.000Z","published":"2023","updated":"2023-08-11T01:07:18.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2308.05365","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}