UTF-8(with BOM)与UTF-8相互转换

Eclipse采用UTF-8 BOM格式编码，而Linux下采用UTF-8无BOM格式。BOM用来标记编码的字节顺序，但是由于编码字节顺序对于UTF-8来说无关紧要，而且Unicode标准也并不推荐使用带BOM的UTF-8编码格式。总之，由于Windows和Linux的不同，为避免使用Notepad++手动更改大量文件的繁琐，提供shell转换脚本如下：

UTF-8(with BOM)转UTF-8：

#!/bin/bash
#将UTF-8带BOM编码的文件转化为UTF-8无BOM格式
if [[ -z "$1" ]];then
    echo ‘用法：./rmbom.sh [folder | file]‘
    echo ‘将UTF-8编码的文件转化为UTF-8无BOM格式‘
    exit 1
fi
 
 
path=$1
find $path -type f -name "*" -print | xargs -i sed -i ‘1 s/^\xef\xbb\xbf//‘ {}
echo "Convert finish"

UTF-8转UTF-8(with BOM)：

#!/bin/bash
#将UTF-8无BOM编码的文件转化为UTF-8带BOM格式
 
 
if [[ -z "$1" ]];then
    echo ‘用法：./addbom.sh [folder | file]‘
    echo ‘将UTF-8无BOM格式编码的文件转化为UTF-8带BOM‘
    exit 1
fi
 
 
path=$1
find $path -type f -name "*" -print | xargs -i sed -i ‘1 s/^/\xef\xbb\xbf&/‘ {}
echo "Convert finish"

UTF-8(with BOM)与UTF-8相互转换

原文：https://www.cnblogs.com/MessiXiaoMo3334/p/12757961.html