With the rapid development of China’s economy and people’s higher and higher requirements for living standards, energy conservation and emission reduction are becoming more and more important to achieve the goal of “carbon peak” and “carbon neutrality”. Vacuum Insolation Panels (VIPs) are a new type of high-efficiency thermal insulation material. The core material of VIPs serves as the backbone structure and plays a crucial role in both supporting and facilitating heat transfer within the panel, thus ensuring its thermal insulation performance. Based on this, this article first focused on the significance of the application of VIPs in green buildings and cold chain logistics, and identified the key issues currently hindering the development of VIPs. It then reviewed the research status and progress of VIP core materials, compared different types of core materials (particle-based, foam-based, fiber-based, biomass-based and composite-based) in terms of raw material sources, thermal insulation performance, production processes and environmental protection with particular emphasis on the comparison of green and renewable biomass-based materials as core materials for VIPs. Finally, the future research directions and development prospects of VIP core materials were summarized and discussed. This paper pointed out that traditional VIPs, which used glass fiber, organic foam or aerogel as core materials, faced issues such as high production costs, non-renewability, difficult degradation and environmental pollution. Therefore, obtaining novel, green, low-cost core materials with excellent micro-porous structures and high thermal resistance through functionalization was the key to the development of VIPs. Biomass material had the advantages of wide source, low cost, green environmental protection and rich pore structure, etc. It was a kind of VIP core material with great potential, and would also be an important research direction of vacuum insulation panel core material. Therefore, the future development of biomass-based core material VIPs required further diversification of material sources, improvement of preparation methods and processes, clarification of aging and performance under service conditions, and attention to the development of composite core materials in order to continuously improve VIP performance and expand its application domains.