The rapid rise of artificial intelligence is reshaping various industries, compelling public sector organizations to hasten their adoption of AI technologies. However, these government entities encounter unique challenges related to security, governance, and operational limitations that differentiate them from the private sector. In light of these hurdles, specially designed small language models (SLMs) emerge as a viable solution to effectively implement AI in public services, ensuring compliance with stringent regulations while enhancing operational efficiency and decision-making processes. By leveraging these tailored models, public agencies can harness the power of AI to better serve their communities.