{"id":527,"date":"2025-10-26T09:38:16","date_gmt":"2025-10-26T08:38:16","guid":{"rendered":"https:\/\/www.silverice.it\/IpercubeTechWP1\/?page_id=527"},"modified":"2025-10-30T16:04:18","modified_gmt":"2025-10-30T15:04:18","slug":"detectencodingandgetstring","status":"publish","type":"page","link":"https:\/\/www.silverice.it\/IpercubeTechWP1\/ipercube-utilities\/string-functions\/detectencodingandgetstring\/","title":{"rendered":"Text Analysis &#8211; Detect Encoding and Get String"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Detects the encoding of a byte array based on its byte order mark (BOM) and converts it to a string.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>If the byte array starts with EF BB BF, UTF-8 with BOM is used.<\/li>\n\n\n\n<li>If the byte array starts with FF FE, UTF-16 LE is assumed.<\/li>\n\n\n\n<li>If the byte array starts with FE FF, UTF-16 BE is assumed.<\/li>\n\n\n\n<li>If no BOM is detected, UTF-8 without BOM is used as the default.<\/li>\n<\/ul>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:75%\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column page-snippet is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:100%\">\n<div class=\"wp-block-kevinbatdorf-code-block-pro cbp-has-line-numbers\" data-code-block-pro-font-family=\"Code-Pro-Geist-Mono\" style=\"font-size:.875rem;font-family:Code-Pro-Geist-Mono,ui-monospace,SFMono-Regular,Menlo,Monaco,Consolas,monospace;--cbp-line-number-color:#D4D4D4;--cbp-line-number-width:calc(2 * 0.6 * .875rem);line-height:1.25rem;--cbp-tab-width:2;tab-size:var(--cbp-tab-width, 2)\"><span style=\"display:flex;align-items:center;padding:10px 0px 10px 16px;margin-bottom:-2px;width:100%;text-align:left;background-color:#2b2b2b;color:#c7c7c7\">VB<\/span><span role=\"button\" tabindex=\"0\" style=\"color:#D4D4D4;display:none\" aria-label=\"Copy\" class=\"code-block-pro-copy-button\"><pre class=\"code-block-pro-copy-button-pre\" aria-hidden=\"true\"><textarea class=\"code-block-pro-copy-button-textarea\" tabindex=\"-1\" aria-hidden=\"true\" readonly>    Public Function DetectEncodingAndGetString(bytes As Byte()) As String\n    \n        If bytes Is Nothing Then Return String.Empty\n        \n        Dim enc As Encoding = Encoding.UTF8\n        If bytes.Length >= 3 AndAlso bytes(0) = &amp;HEF AndAlso bytes(1) = &amp;HBB AndAlso bytes(2) = &amp;HBF Then\n            enc = New UTF8Encoding(encoderShouldEmitUTF8Identifier:=True)\n        ElseIf bytes.Length >= 2 AndAlso bytes(0) = &amp;HFF AndAlso bytes(1) = &amp;HFE Then\n            enc = Encoding.Unicode\n        ElseIf bytes.Length >= 2 AndAlso bytes(0) = &amp;HFE AndAlso bytes(1) = &amp;HFF Then\n            enc = Encoding.BigEndianUnicode\n        End If\n        \n        Return enc.GetString(bytes)\n    End Function<\/textarea><\/pre><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" style=\"width:24px;height:24px\" fill=\"none\" viewBox=\"0 0 24 24\" stroke=\"currentColor\" stroke-width=\"2\"><path class=\"with-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M4.5 12.75l6 6 9-13.5\"><\/path><path class=\"without-check\" stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M16.5 8.25V6a2.25 2.25 0 00-2.25-2.25H6A2.25 2.25 0 003.75 6v8.25A2.25 2.25 0 006 16.5h2.25m8.25-8.25H18a2.25 2.25 0 012.25 2.25V18A2.25 2.25 0 0118 20.25h-7.5A2.25 2.25 0 018.25 18v-1.5m8.25-8.25h-6a2.25 2.25 0 00-2.25 2.25v6\"><\/path><\/svg><\/span><pre class=\"shiki dark-plus\" style=\"background-color: #1E1E1E\" tabindex=\"0\"><code><span class=\"line\"><span style=\"color: #D4D4D4\">    <\/span><span style=\"color: #569CD6\">Public Function <\/span><span style=\"color: #DCDCAA\">DetectEncodingAndGetString<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #9CDCFE\">bytes<\/span><span style=\"color: #D4D4D4\"> As <\/span><span style=\"color: #4EC9B0\">Byte<\/span><span style=\"color: #D4D4D4\">()) As <\/span><span style=\"color: #4EC9B0\">String<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">    <\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><span style=\"color: #C586C0\">If<\/span><span style=\"color: #D4D4D4\"> bytes Is<\/span><span style=\"color: #569CD6\"> Nothing<\/span><span style=\"color: #D4D4D4\"> <\/span><span style=\"color: #C586C0\">Then<\/span><span style=\"color: #D4D4D4\"> <\/span><span style=\"color: #C586C0\">Return<\/span><span style=\"color: #D4D4D4\"> <\/span><span style=\"color: #DCDCAA\">String<\/span><span style=\"color: #D4D4D4\">.<\/span><span style=\"color: #569CD6\">Empty<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><span style=\"color: #569CD6\">Dim<\/span><span style=\"color: #9CDCFE\"> enc <\/span><span style=\"color: #D4D4D4\">As <\/span><span style=\"color: #4EC9B0\">Encoding<\/span><span style=\"color: #D4D4D4\"> = Encoding.UTF8<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><span style=\"color: #C586C0\">If<\/span><span style=\"color: #D4D4D4\"> bytes.<\/span><span style=\"color: #9CDCFE\">Length<\/span><span style=\"color: #D4D4D4\"> &gt;= <\/span><span style=\"color: #B5CEA8\">3<\/span><span style=\"color: #D4D4D4\"> AndAlso <\/span><span style=\"color: #DCDCAA\">bytes<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #B5CEA8\">0<\/span><span style=\"color: #D4D4D4\">) = &amp;<\/span><span style=\"color: #9CDCFE\">HEF<\/span><span style=\"color: #D4D4D4\"> AndAlso <\/span><span style=\"color: #DCDCAA\">bytes<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #B5CEA8\">1<\/span><span style=\"color: #D4D4D4\">) = &amp;<\/span><span style=\"color: #9CDCFE\">HBB<\/span><span style=\"color: #D4D4D4\"> AndAlso <\/span><span style=\"color: #DCDCAA\">bytes<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #B5CEA8\">2<\/span><span style=\"color: #D4D4D4\">) = &amp;<\/span><span style=\"color: #9CDCFE\">HBF<\/span><span style=\"color: #D4D4D4\"> <\/span><span style=\"color: #C586C0\">Then<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">            <\/span><span style=\"color: #9CDCFE\">enc<\/span><span style=\"color: #D4D4D4\"> =<\/span><span style=\"color: #569CD6\"> New <\/span><span style=\"color: #DCDCAA\">UTF8Encoding<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #9CDCFE\">encoderShouldEmitUTF8Identifier<\/span><span style=\"color: #D4D4D4\">:=<\/span><span style=\"color: #569CD6\">True<\/span><span style=\"color: #D4D4D4\">)<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><span style=\"color: #C586C0\">ElseIf<\/span><span style=\"color: #D4D4D4\"> bytes.<\/span><span style=\"color: #9CDCFE\">Length<\/span><span style=\"color: #D4D4D4\"> &gt;= <\/span><span style=\"color: #B5CEA8\">2<\/span><span style=\"color: #D4D4D4\"> AndAlso <\/span><span style=\"color: #DCDCAA\">bytes<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #B5CEA8\">0<\/span><span style=\"color: #D4D4D4\">) = &amp;<\/span><span style=\"color: #9CDCFE\">HFF<\/span><span style=\"color: #D4D4D4\"> AndAlso <\/span><span style=\"color: #DCDCAA\">bytes<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #B5CEA8\">1<\/span><span style=\"color: #D4D4D4\">) = &amp;<\/span><span style=\"color: #9CDCFE\">HFE<\/span><span style=\"color: #D4D4D4\"> <\/span><span style=\"color: #C586C0\">Then<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">            <\/span><span style=\"color: #9CDCFE\">enc<\/span><span style=\"color: #D4D4D4\"> = Encoding.Unicode<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><span style=\"color: #C586C0\">ElseIf<\/span><span style=\"color: #D4D4D4\"> bytes.<\/span><span style=\"color: #9CDCFE\">Length<\/span><span style=\"color: #D4D4D4\"> &gt;= <\/span><span style=\"color: #B5CEA8\">2<\/span><span style=\"color: #D4D4D4\"> AndAlso <\/span><span style=\"color: #DCDCAA\">bytes<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #B5CEA8\">0<\/span><span style=\"color: #D4D4D4\">) = &amp;<\/span><span style=\"color: #9CDCFE\">HFE<\/span><span style=\"color: #D4D4D4\"> AndAlso <\/span><span style=\"color: #DCDCAA\">bytes<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #B5CEA8\">1<\/span><span style=\"color: #D4D4D4\">) = &amp;<\/span><span style=\"color: #9CDCFE\">HFF<\/span><span style=\"color: #D4D4D4\"> <\/span><span style=\"color: #C586C0\">Then<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">            <\/span><span style=\"color: #9CDCFE\">enc<\/span><span style=\"color: #D4D4D4\"> = Encoding.BigEndianUnicode<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><span style=\"color: #C586C0\">End If<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">        <\/span><span style=\"color: #C586C0\">Return<\/span><span style=\"color: #D4D4D4\"> enc.<\/span><span style=\"color: #DCDCAA\">GetString<\/span><span style=\"color: #D4D4D4\">(<\/span><span style=\"color: #9CDCFE\">bytes<\/span><span style=\"color: #D4D4D4\">)<\/span><\/span>\n<span class=\"line\"><span style=\"color: #D4D4D4\">    <\/span><span style=\"color: #569CD6\">End Function<\/span><\/span><\/code><\/pre><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Detects the encoding of a byte array based on its byte order mark (BOM) and converts it to a string.<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":167,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-527","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/pages\/527","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/comments?post=527"}],"version-history":[{"count":3,"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/pages\/527\/revisions"}],"predecessor-version":[{"id":855,"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/pages\/527\/revisions\/855"}],"up":[{"embeddable":true,"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/pages\/167"}],"wp:attachment":[{"href":"https:\/\/www.silverice.it\/IpercubeTechWP1\/wp-json\/wp\/v2\/media?parent=527"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}