During the Operating System Industry Summit 2021, Huawei has officially announced the donation of its OpenEuler operating system open source code to OpenAtom Foundation.
Huawei will donate the full amount of OpenEuler open source operating system code, brand trademarks, community infrastructure, and other related assets to the OpenAtom Open Source Foundation to build more Strong digital infrastructure, said Wang Tao, Executive Director of Huawei and Director of the ICT infrastructure Business Management Committee.
OpenEuler has been upgraded from a server operating system to an operating system for digital infrastructure, supporting the full scenarios of digital infrastructure such as IT, CT, and OT, covering the needs of various forms such as server, cloud, edge, and embedded.
With the release of version 21.09, openEuler already includes four application scenarios:
- Cloud native
- Edge computing
- Embedded System
Currently, the OpenEuler community has around 10000 developers, around a hundred special interest groups, and 300 partner companies. This operating system enables huge possibilities and combines the power of processors, machines, basic software, application software, industry customers, and other partners in the entire industry chain.
Chinese mainstream operating system manufacturers have also launched commercial releases based on OpenEuler, which is in the core systems in the government, operators, finance, energy, power, transportation, and other industries.
Euler Commercial version has exceeded 600,000 sets and it is expected to achieve the first new market share in China’s server by next year.
Huawei Vice President and President of computing product line – Deng Taihua promised Euler’s donation in the keynote speech of the conference. He said, Huawei will continue to invest and promote the use cases and the development of OpenEuler operating system in terms of five aspects:
- Technological innovation
- Ecosystem construction
- Commercial promotion
- Open Source construction
- Talent Development
So, what’s under this donation?
the content of this Euler donation includes code and software packages. Millions of lines of Huawei’s self-developed code copyrights and intellectual property licenses, more than 8,000 software packages verified by Huawei and the community; innovation projects.
Huawei’s innovative iSula, A-Tune, Stratovirt, secGear projects. Trademarks: openEuler and iSula, A-Tune, Stratovirt, secGear projects, a total of 30 Chinese and English trademark brands. Domain names: openeuler.org and its subdomains, and openeuler.io and its subdomains, A total of 4. It also includes community infrastructure: building community infrastructure such as service and testing systems, code hosting, and community operation platforms.
Aside from OpenEuler, OpenAtom Foundation also has the open source code rights of OpenHarmony project, which is the open source code of HarmonyOS.
OpenAtom OpenSource Foundation is a joint community collaboratively formed by the leading companies including Huawei Alibaba, Baidu, Inspur, Qihoo, Tencent, China Merchants Bank, and so on. It aims to develop an open framework and international open-source communities in the industry.
It offers neutral management of intellectual property, consultation, operation, marketing, education, and training-related services concerning the open-source software, hardware, chips, and contents.
Huawei adds new compiler to OpenEuler operating system
OpenEuler Community has officially announced that the Bisheng compiler is now officially added to the OpenEuler operating system software repository. The latest software addition could be fetched for use cases.
In terms of benchmark, the new Huawei compiler for the OpenEuler operating system has version 2.1.0 and improves 24.3 percent of the hardware and software performance to run smoother and better applications.
Bisheng Compiler is a high-performance, reliable, and easily extensible compiler created by Huawei Compiler Lab. It supports C/C++/Fortran and other programming languages.
The compiler also enhances and introduces a variety of compilation and optimization technologies, aiming at certain application scenarios. It is optimized especially in high-performance computing (HPC) scenarios to obtain better performance benefits.
Bisheng 2.1.0 was released on December 30 last year and the current version enhances the loop optimization, structure reorganization optimization, block reorder optimization features, improves the performance of multiple sub-items of SPEC CPU 2017 and HPC workload.
The update adds support for pow initialization immediate data fitting, mathematical function control, and other precision control options, to further enhance the precision tuning options.
This update support multi-threaded parallel programming technology and Input/output enhancements (Fortran 2003) / asynchronous IO features to meet the Kunpeng scene’s needs for the Fortran language ecology.
Features Optimized with this update:
Bisheng Compiler adopts a variety of enhanced compilation optimization techniques, including but not limited to the following optimization features:
- Including Loop Unswitching: reduce the number of executions of branch jumps.
- Loop unroll-and-jam: Improve memory and cache locality and utilization.
- Loop Fusion: Directly reuse values in other loops, exposing more instruction scheduling opportunities.
- Loop Distribution: Reduce register pressure in loops and expose more vectorization opportunities.
- Loop Unrolling: This can reduce the number of dynamic instructions and discover more optimization opportunities, such as data reuse, wider instruction scheduling, and improved vectorization Data concurrency.
Memory layout optimization
Convert Array of Structures (AoS) to Structure of Arrays (SoA), and rearrangement optimization of arrays. Through the above method, the hit rate of the Cache will be improved, thereby improving the performance of the program.
By cooperating with the Kunpeng processor, the Bisheng compiler can accurately model the hardware-related characteristics, so that the compiler prefetch analysis code can accurately simulate the memory access characteristics of the Kunpeng processor, and then insert accurate prefetch instructions into the code, thereby improving the performance of the processor. Cache hit rate to improve program performance.
Combined with the Kunpeng NEON / SVE instruction set, Bisheng Compiler enhances vector automation, converting scalar programs that perform similar operations into vectorized programs so that computer programs can use one instruction to process multiple data and improve program performance.
Based on the ML automatic search technology, through multiple iterations, the optimal option is found in the optimizable space, and then the target program with better performance is compiled.
- Performance – test environment:
- OS: OpenEuler 20.03
- CPU: Kunpeng 920
The Bisheng compiler development team conducted performance evaluation based on the Bisheng compiler version 2.1.0. The SPEC CPU 2017 test report showed that the Bisheng compiler 2.1.0 achieved a comprehensive score of 399 points, and the GCC 9.3.0 comprehensive score was 321 points. Under the same hardware and software environment, the performance of Bisheng compiler is 24.3% higher than that of GCC.
(via – ithome)
Huawei opens China’s first EulerOS ecosystem innovation center
On January 3, 2022, Huawei and the government of Binhu District in China, unveiled the Wuxi Ascend and Euler Ecosystem innovation center. This new Huawei EulerOS innovation center is the first of its kind in China.
According to Huawei, Wuxi Shengteng & Euler Eco-Innovation Center is ecosystem cultivation and industrial development centered on the two root technologies of Shengteng AI basic software and hardware platform and EulerOS open-source operating system.
It aims at building a public computing power service platform and an application innovation incubation platform, Industrial aggregation development platform, scientific research & talent training platform.
The overall efforts are to provide a full-stack independent innovation of Shengteng AI software and hardware platform, operating system, development framework, toolchain, and deep learning platform.
EulerOS is an open-source operating system for digital infrastructure, which can be deployed on servers, cloud computing, edge computing, embedded devices, and other devices. The EulerOS can be used in sectors – IT (Information Technology), CT (Communication Technology), and OT (Operational Technology).
Euler and HarmonyOS:
During the 2021 China 5G + Industrial Internet Conference, Huawei revealed that OpenHarmony and OpenEuler operating systems are being built side by side and are important to form the digital infrastructure.
Huawei chairman, Hu Houkun said 5G + Industrial Internet is empowering the digital transformation of thousands of industries, and data-driven is the key. It is now necessary to achieve data acquisition, fast calculation, and good use, connecting more devices, lowering the threshold of AI, and developing industrial software. The key investment areas of the phase.
(via – ithome)
CTyunOS launched based on Huawei OpenEuler operating system
At OpenEuler Summit 2021, Huawei has officially donated the OpenEuler open source operating system to OpenAtom Foundation. At the same time, the company also announced the launch of CTyunOS, a cloud operating system based on the Huawei OpenEuler operating system.
According to the information, CTyunOS also means that Tianyi Cloud is gradually starting to deploy the underlying core technology. Moreover, with the new trends in the operating system field, combined with its own business requirements, China Telecom has launched the Huawei OpenEuler based operating system – CTyunOS based on the cloud network integration strategy.
China Telecom is the first in the industry to inherit the Huawei OpenEuler technology route for all services via CTyunOS. Simultaneously, it is the first operator to launch a dual version of OpenEuler based x86 and ARM independently developed.
The telecom service provider has achieved large scale commercial use and provides a unified cloud network edge. Operating system services.
China Telecom has been participating in the work of the OpenStack SIG since joining the Euler open source community. It has participated in the software migration of the OpenStack Q version throughout the entire process and has tested and verified the functions and compatibility.
After the release of openEuler 21.03, China Telecom passed and Kernel SIG cooperated to explore the use scenarios of EtMem. China Telecom contributed its experience in system resource pressure detection to the community and submitted and contributed PSI tools to the community.
China Telecom’s Tianyi cloud operating system CTyunOS provides the following technology research and development optimization. Through the optimization of the system kernel, the performance has been greatly improved.
Through a number of unique innovative technologies, the virtualization components are deeply customized to provide high Performance and low-latency virtualization capabilities. With the self-developed cloud platform computing management and other key components, the overall performance of the cloud platform is improved in multiple dimensions.
Through the adaptation and optimization of chips of different architectures, it provides homology and heterogeneous support capabilities. At the same time, It also greatly enhances the security features of the system and is a professional server operating system for cloud computing.
CTyunOS Top Features:
Optimizing kernel performance:
Innovative use of domain scheduling technology in the kernel improves the performance of process scheduling in a variety of scenarios. The performance of CPU, memory, IO, and network schedule is 17% ahead of the industry benchmark CentOS. Big data, web, and database scenarios lead CentOS by 15%-22%.
The NMI mechanism based on SEDI and PMU can perform more accurate performance analysis. By limiting the proportion of memory occupied by the page cache, the business runs more smoothly. With statistical profiling extension (Statistical Profiling Extension) to enhance the tuning capabilities under perf, It also supports hot swap of SAS/NVME disks.
Enhanced virtualization capabilities:
In-depth customization for KVM, through the CPU integration mechanism, CPU intelligent scheduling and other technologies, to provide high-performance, low-latency virtualization capabilities.
Supports smart network cards, can flexibly implement network and storage offloading, reduce host CPU and memory consumption, thereby greatly improving performance and virtual machine density.
Improve cloud platform capabilities:
The computing management component created by Tianyi Cloud provides a low-latency, high-performance cloud platform that supports ultra-large-scale clusters (10k + host clusters).
The customized authentication component GoStone project, compared with OpenStack Keystone, greatly improves authentication performance by caching, upgrading token generation methods, and optimizing password encryption methods, and has up to 100 times the security performance under the same resource consumption. promote.
The steel bare metal management component adopts squashfs lightweight and small-size mirroring, which is easier to save and transmit, and the online cycle is shortened to minutes. The pure asynchronous system architecture design provides flexible and scalable clustering capabilities.
Adapt to ARM and X86, support diverse computing power:
Adapt to heterogeneous computing power, support X86, ARM, and other architectures, and adapt and optimize on Kunpeng, Feiteng, Zhaoxin, and Haiguang. For multi-core scenarios, improve the parallelism of CPU multi-cores in terms of scheduling, locking, and reduce CPU shared resource conflicts to achieve task acceleration.
Use ktask to parallel single-core serial tasks to multiple CPUs for execution, making full use of the advantages of multi-core. Speed up by Kunpeng The engine KAE realizes the hardware acceleration of the encryption algorithm. Through the ARM64 kernel hot patch, the characteristics of the ARM64 instruction set are used to improve the performance of the basic library and the performance of CRC verification.
Enhance system security:
It can provide IMA integrity measurement framework and secGear confidential computing framework, which can judge whether the operating environment is safe and reliable, and shield the differences of confidential computing SDK under different architectures, making the calling process more efficient and easy to use.
At the same time, it can provide The security architecture tool security-tool makes security settings more convenient and automated.
Memory hierarchical expansion:
Memory hierarchical expansion uses DRAM and low-speed memory media such as SCM, AEP and other different memories according to different strategies. Through memory hierarchical scheduling, hot data can run in the DRAM high-speed memory area, and cold data can be exchanged to the low-speed memory area to achieve improvement.
The effect of physical memory usage efficiency. This feature is suitable for memory capacity-sensitive applications, such as mysql database, spark, and other applications. Joint innovation with Tianyi Cloud in the virtual machine scenario. When the expansion medium is AEP, the business performance of turning on etmem is about 30% higher than when not turning on etmem, which improves the cost-effectiveness of physical memory.