{"data":{"id":"10.48550/arxiv.2611.02738","type":"dois","attributes":{"doi":"10.48550/arxiv.2611.02738","prefix":"10.48550","suffix":"arxiv.2611.02738","identifiers":[{"identifier":"2611.02738","identifierType":"arXiv"}],"alternateIdentifiers":[{"alternateIdentifierType":"arXiv","alternateIdentifier":"2611.02738"}],"creators":[{"name":"Luo, Xiangyun","nameType":"Personal","givenName":"Xiangyun","familyName":"Luo","affiliation":[],"nameIdentifiers":[]},{"name":"Zhang, Yunkai","nameType":"Personal","givenName":"Yunkai","familyName":"Zhang","affiliation":[],"nameIdentifiers":[]},{"name":"Huang, Yong","nameType":"Personal","givenName":"Yong","familyName":"Huang","affiliation":[],"nameIdentifiers":[]},{"name":"Wu, Stephen","nameType":"Personal","givenName":"Stephen","familyName":"Wu","affiliation":[],"nameIdentifiers":[]},{"name":"Li, Hui","nameType":"Personal","givenName":"Hui","familyName":"Li","affiliation":[],"nameIdentifiers":[]}],"titles":[{"title":"Multi-Modal Multi-Agent System for Bridge Operation and Maintenance based on Large Language Model"}],"publisher":"arXiv","container":{},"publicationYear":2026,"subjects":[{"lang":"en","subject":"Multiagent Systems (cs.MA)","subjectScheme":"arXiv"},{"subject":"FOS: Computer and information sciences","subjectScheme":"Fields of Science and Technology (FOS)"}],"contributors":[],"dates":[{"date":"2026-11-02T08:26:24Z","dateType":"Submitted","dateInformation":"v1"},{"date":"2026-11-03T05:13:05Z","dateType":"Updated","dateInformation":"v1"},{"date":"2026-11","dateType":"Available","dateInformation":"v1"}],"language":null,"types":{"ris":"GEN","bibtex":"misc","citeproc":"article","schemaOrg":"CreativeWork","resourceType":"Article","resourceTypeGeneral":"Preprint"},"relatedIdentifiers":[],"relatedItems":[],"sizes":[],"formats":[],"version":"1","rightsList":[{"rights":"arXiv.org perpetual, non-exclusive license","rightsUri":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/"}],"descriptions":[{"description":"Bridges are critical transportation infrastructure, and reliable operation and maintenance (O\u0026amp;M) is essential for traffic safety and long-term structural performance. However, bridge O\u0026amp;M faces key bottlenecks: no unified architecture coordinates heterogeneous resources; model inferences lack clear links to physical-mechanical laws; and experts' tacit knowledge remains difficult to formalize. This study proposes a knowledge-enhanced autonomy formalization methodology and apply it to construct the Bridge O\u0026amp;M Multi-Modal Multi-Agent System (BOMMA), which integrates heterogeneous diagnostic actions, physics-mechanics-informed representations, long-term memory, and structured experiential knowledge within a coordinated multi-agent workflow, enabling interpretable and traceable scheduling, analysis, and decision-making. On 3,492 multi-source instructions, the proposed method achieves scheduling recalls of 85.37% for simple and 99.40% for composite tasks, with 95.35% BERT F1-score for O\u0026amp;M action reasoning. Ablation studies confirm the contributions of the components in the autonomy. This study bridges general LLM reasoning and specialized bridge O\u0026amp;M requirements.","descriptionType":"Abstract"},{"description":"46 pages, 8 figures","descriptionType":"Other"}],"geoLocations":[],"fundingReferences":[],"xml":"PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPHJlc291cmNlIHhtbG5zPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCIgeG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNpOnNjaGVtYUxvY2F0aW9uPSJodHRwOi8vZGF0YWNpdGUub3JnL3NjaGVtYS9rZXJuZWwtNCBodHRwOi8vc2NoZW1hLmRhdGFjaXRlLm9yZy9tZXRhL2tlcm5lbC00LjMvbWV0YWRhdGEueHNkIj4KICA8aWRlbnRpZmllciBpZGVudGlmaWVyVHlwZT0iRE9JIj4xMC40ODU1MC9BUlhJVi4yNjExLjAyNzM4PC9pZGVudGlmaWVyPgogIDxhbHRlcm5hdGVJZGVudGlmaWVycz4KICAgIDxhbHRlcm5hdGVJZGVudGlmaWVyIGFsdGVybmF0ZUlkZW50aWZpZXJUeXBlPSJhclhpdiI+MjYxMS4wMjczODwvYWx0ZXJuYXRlSWRlbnRpZmllcj4KICA8L2FsdGVybmF0ZUlkZW50aWZpZXJzPgogIDxjcmVhdG9ycz4KICAgIDxjcmVhdG9yPgogICAgICA8Y3JlYXRvck5hbWUgbmFtZVR5cGU9IlBlcnNvbmFsIj5MdW8sIFhpYW5neXVuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5YaWFuZ3l1bjwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5MdW88L2ZhbWlseU5hbWU+CiAgICA8L2NyZWF0b3I+CiAgICA8Y3JlYXRvcj4KICAgICAgPGNyZWF0b3JOYW1lIG5hbWVUeXBlPSJQZXJzb25hbCI+WmhhbmcsIFl1bmthaTwvY3JlYXRvck5hbWU+CiAgICAgIDxnaXZlbk5hbWU+WXVua2FpPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPlpoYW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkh1YW5nLCBZb25nPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5Zb25nPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPkh1YW5nPC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPld1LCBTdGVwaGVuPC9jcmVhdG9yTmFtZT4KICAgICAgPGdpdmVuTmFtZT5TdGVwaGVuPC9naXZlbk5hbWU+CiAgICAgIDxmYW1pbHlOYW1lPld1PC9mYW1pbHlOYW1lPgogICAgPC9jcmVhdG9yPgogICAgPGNyZWF0b3I+CiAgICAgIDxjcmVhdG9yTmFtZSBuYW1lVHlwZT0iUGVyc29uYWwiPkxpLCBIdWk8L2NyZWF0b3JOYW1lPgogICAgICA8Z2l2ZW5OYW1lPkh1aTwvZ2l2ZW5OYW1lPgogICAgICA8ZmFtaWx5TmFtZT5MaTwvZmFtaWx5TmFtZT4KICAgIDwvY3JlYXRvcj4KICA8L2NyZWF0b3JzPgogIDx0aXRsZXM+CiAgICA8dGl0bGU+TXVsdGktTW9kYWwgTXVsdGktQWdlbnQgU3lzdGVtIGZvciBCcmlkZ2UgT3BlcmF0aW9uIGFuZCBNYWludGVuYW5jZSBiYXNlZCBvbiBMYXJnZSBMYW5ndWFnZSBNb2RlbDwvdGl0bGU+CiAgPC90aXRsZXM+CiAgPHB1Ymxpc2hlcj5hclhpdjwvcHVibGlzaGVyPgogIDxwdWJsaWNhdGlvblllYXI+MjAyNjwvcHVibGljYXRpb25ZZWFyPgogIDxzdWJqZWN0cz4KICAgIDxzdWJqZWN0IHhtbDpsYW5nPSJlbiIgc3ViamVjdFNjaGVtZT0iYXJYaXYiPk11bHRpYWdlbnQgU3lzdGVtcyAoY3MuTUEpPC9zdWJqZWN0PgogICAgPHN1YmplY3Qgc3ViamVjdFNjaGVtZT0iRmllbGRzIG9mIFNjaWVuY2UgYW5kIFRlY2hub2xvZ3kgKEZPUykiPkZPUzogQ29tcHV0ZXIgYW5kIGluZm9ybWF0aW9uIHNjaWVuY2VzPC9zdWJqZWN0PgogIDwvc3ViamVjdHM+CiAgPGRhdGVzPgogICAgPGRhdGUgZGF0ZVR5cGU9IlN1Ym1pdHRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyNi0xMS0wMlQwODoyNjoyNFo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iVXBkYXRlZCIgZGF0ZUluZm9ybWF0aW9uPSJ2MSI+MjAyNi0xMS0wM1QwNToxMzowNVo8L2RhdGU+CiAgICA8ZGF0ZSBkYXRlVHlwZT0iQXZhaWxhYmxlIiBkYXRlSW5mb3JtYXRpb249InYxIj4yMDI2LTExPC9kYXRlPgogIDwvZGF0ZXM+CiAgPHJlc291cmNlVHlwZSByZXNvdXJjZVR5cGVHZW5lcmFsPSJQcmVwcmludCI+QXJ0aWNsZTwvcmVzb3VyY2VUeXBlPgogIDx2ZXJzaW9uPjE8L3ZlcnNpb24+CiAgPHJpZ2h0c0xpc3Q+CiAgICA8cmlnaHRzIHJpZ2h0c1VSST0iaHR0cDovL2FyeGl2Lm9yZy9saWNlbnNlcy9ub25leGNsdXNpdmUtZGlzdHJpYi8xLjAvIj5hclhpdi5vcmcgcGVycGV0dWFsLCBub24tZXhjbHVzaXZlIGxpY2Vuc2U8L3JpZ2h0cz4KICA8L3JpZ2h0c0xpc3Q+CiAgPGRlc2NyaXB0aW9ucz4KICAgIDxkZXNjcmlwdGlvbiBkZXNjcmlwdGlvblR5cGU9IkFic3RyYWN0Ij5CcmlkZ2VzIGFyZSBjcml0aWNhbCB0cmFuc3BvcnRhdGlvbiBpbmZyYXN0cnVjdHVyZSwgYW5kIHJlbGlhYmxlIG9wZXJhdGlvbiBhbmQgbWFpbnRlbmFuY2UgKE8mYW1wO00pIGlzIGVzc2VudGlhbCBmb3IgdHJhZmZpYyBzYWZldHkgYW5kIGxvbmctdGVybSBzdHJ1Y3R1cmFsIHBlcmZvcm1hbmNlLiBIb3dldmVyLCBicmlkZ2UgTyZhbXA7TSBmYWNlcyBrZXkgYm90dGxlbmVja3M6IG5vIHVuaWZpZWQgYXJjaGl0ZWN0dXJlIGNvb3JkaW5hdGVzIGhldGVyb2dlbmVvdXMgcmVzb3VyY2VzOyBtb2RlbCBpbmZlcmVuY2VzIGxhY2sgY2xlYXIgbGlua3MgdG8gcGh5c2ljYWwtbWVjaGFuaWNhbCBsYXdzOyBhbmQgZXhwZXJ0cycgdGFjaXQga25vd2xlZGdlIHJlbWFpbnMgZGlmZmljdWx0IHRvIGZvcm1hbGl6ZS4gVGhpcyBzdHVkeSBwcm9wb3NlcyBhIGtub3dsZWRnZS1lbmhhbmNlZCBhdXRvbm9teSBmb3JtYWxpemF0aW9uIG1ldGhvZG9sb2d5IGFuZCBhcHBseSBpdCB0byBjb25zdHJ1Y3QgdGhlIEJyaWRnZSBPJmFtcDtNIE11bHRpLU1vZGFsIE11bHRpLUFnZW50IFN5c3RlbSAoQk9NTUEpLCB3aGljaCBpbnRlZ3JhdGVzIGhldGVyb2dlbmVvdXMgZGlhZ25vc3RpYyBhY3Rpb25zLCBwaHlzaWNzLW1lY2hhbmljcy1pbmZvcm1lZCByZXByZXNlbnRhdGlvbnMsIGxvbmctdGVybSBtZW1vcnksIGFuZCBzdHJ1Y3R1cmVkIGV4cGVyaWVudGlhbCBrbm93bGVkZ2Ugd2l0aGluIGEgY29vcmRpbmF0ZWQgbXVsdGktYWdlbnQgd29ya2Zsb3csIGVuYWJsaW5nIGludGVycHJldGFibGUgYW5kIHRyYWNlYWJsZSBzY2hlZHVsaW5nLCBhbmFseXNpcywgYW5kIGRlY2lzaW9uLW1ha2luZy4gT24gMyw0OTIgbXVsdGktc291cmNlIGluc3RydWN0aW9ucywgdGhlIHByb3Bvc2VkIG1ldGhvZCBhY2hpZXZlcyBzY2hlZHVsaW5nIHJlY2FsbHMgb2YgODUuMzclIGZvciBzaW1wbGUgYW5kIDk5LjQwJSBmb3IgY29tcG9zaXRlIHRhc2tzLCB3aXRoIDk1LjM1JSBCRVJUIEYxLXNjb3JlIGZvciBPJmFtcDtNIGFjdGlvbiByZWFzb25pbmcuIEFibGF0aW9uIHN0dWRpZXMgY29uZmlybSB0aGUgY29udHJpYnV0aW9ucyBvZiB0aGUgY29tcG9uZW50cyBpbiB0aGUgYXV0b25vbXkuIFRoaXMgc3R1ZHkgYnJpZGdlcyBnZW5lcmFsIExMTSByZWFzb25pbmcgYW5kIHNwZWNpYWxpemVkIGJyaWRnZSBPJmFtcDtNIHJlcXVpcmVtZW50cy48L2Rlc2NyaXB0aW9uPgogICAgPGRlc2NyaXB0aW9uIGRlc2NyaXB0aW9uVHlwZT0iT3RoZXIiPjQ2IHBhZ2VzLCA4IGZpZ3VyZXM8L2Rlc2NyaXB0aW9uPgogIDwvZGVzY3JpcHRpb25zPgo8L3Jlc291cmNlPg==","url":"https://arxiv.org/abs/2611.02738","contentUrl":null,"metadataVersion":0,"schemaVersion":"http://datacite.org/schema/kernel-4","source":"mds","isActive":true,"state":"findable","reason":null,"viewCount":0,"viewsOverTime":[],"downloadCount":0,"downloadsOverTime":[],"referenceCount":0,"citationCount":0,"citationsOverTime":[],"partCount":0,"partOfCount":0,"versionCount":0,"versionOfCount":0,"created":"2026-11-03T09:59:49.000Z","registered":"2026-11-03T09:59:50.000Z","published":"2026","updated":"2026-11-03T09:59:50.000Z"},"relationships":{"client":{"data":{"id":"arxiv.content","type":"clients"}},"provider":{"data":{"id":"arxiv","type":"providers"}},"media":{"data":{"id":"10.48550/arxiv.2611.02738","type":"media"}},"references":{"data":[]},"citations":{"data":[]},"parts":{"data":[]},"partOf":{"data":[]},"versions":{"data":[]},"versionOf":{"data":[]}}}}