Cryogenic low noise amplifiers (LNAs) are one of the key components in many emerging applications such as radio astronomy or quantum computing in which a weak incoming signal needs to be read out. There have been extensive studies on the feasibility of leveraging silicon-germanium (SiGe) heterojunction bipolar transistors (HBTs) to implement cryogenic LNAs in the past. The deployment of such LNAs in the future large-scale systems in radio astronomy or quantum computing is contingent upon the possibility of developing LNAs with reduced DC power dissipation to enable the cooling of a large number of array elements inside a cryogenic cooler. In this dissertation, we focus on the cryogenic operation of SiGe HBTs at reduced supply voltages for the implementation of ultra low- power LNAs and their applications for scalable receiver systems. In addition, the limitations of the SiGe HBT cryogenic models for the operation at high current densities are investigated for the implementation of modern high speed SiGe HBT circuits.