{"id":23660,"date":"2024-02-22T18:48:48","date_gmt":"2024-02-22T17:48:48","guid":{"rendered":"https:\/\/info.gwdg.de\/news\/?p=23660"},"modified":"2024-02-22T18:48:48","modified_gmt":"2024-02-22T17:48:48","slug":"gwdg-llm-service-generative-ai-for-science","status":"publish","type":"post","link":"https:\/\/info.gwdg.de\/news\/gwdg-llm-service-generative-ai-for-science\/","title":{"rendered":"GWDG LLM Service &#8211; Generative AI for Science"},"content":{"rendered":"<p class=\"part\" data-startline=\"26\" data-endline=\"26\">Starting from February 22nd, 2024, GWDG offers its own ChatGPT service, which runs on in-house hardware. All users with an AcademicCloud account can access the <a href=\"https:\/\/chat-ai.academiccloud.de\/\" target=\"_blank\" rel=\"noopener noreferrer nofollow\" class=\"external\">website<\/a> and chat with a generative AI to support their work. The service is currently based on <a href=\"https:\/\/huggingface.co\/Intel\/neural-chat-7b-v3-1\" target=\"_blank\" rel=\"noopener noreferrer nofollow\" class=\"external\">Intel\u2019s NeuralChat 7b v3.1<\/a> and runs on GWDG\u2019s HPC infrastructure. Using an internally-developed system, the web service is able to dynamically adapt and scale to large request volumes in order to guarantee a fast response time for as many concurrent users as possible.<\/p>\n<p class=\"part\" data-startline=\"32\" data-endline=\"36\">The system was designed with special emphasis on data protection and privacy. The user\u2019s prompts and responses are only stored locally within a session in order to protect the data. Therefore, all prompts and responses are lost when the <a href=\"https:\/\/chat-ai.academiccloud.de\/\" target=\"_blank\" rel=\"noopener noreferrer nofollow\" class=\"external\">website<\/a> is closed. Only the number of requests per user is recorded in order to monitor the demand for this new service. The service is being actively developed to offer more accurate and complex models, and to allow integration with other platforms in the future. If you have any questions or feedback, please contact <a href=\"mailto:support@gwdg.de\" target=\"_blank\" rel=\"noopener noreferrer\">support@gwdg.de<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Starting from February 22nd, 2024, GWDG offers its own ChatGPT service, which runs on in-house hardware. All users with an AcademicCloud account can access the website and chat with a generative AI to support their work. The service is currently based on Intel\u2019s NeuralChat 7b v3.1 and runs on GWDG\u2019s HPC infrastructure. Using an internally-developed &#8230; <a title=\"GWDG LLM Service &#8211; Generative AI for Science\" class=\"read-more\" href=\"https:\/\/info.gwdg.de\/news\/gwdg-llm-service-generative-ai-for-science\/\" aria-label=\"Mehr Informationen \u00fcber GWDG LLM Service &#8211; Generative AI for Science\">Weiterlesen<\/a><\/p>\n","protected":false},"author":10,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-23660","post","type-post","status-publish","format-standard","hentry","category-top-news-en"],"_links":{"self":[{"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/posts\/23660","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/comments?post=23660"}],"version-history":[{"count":1,"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/posts\/23660\/revisions"}],"predecessor-version":[{"id":23661,"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/posts\/23660\/revisions\/23661"}],"wp:attachment":[{"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/media?parent=23660"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/categories?post=23660"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/info.gwdg.de\/news\/wp-json\/wp\/v2\/tags?post=23660"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}