<div>
 Hi, my name is Jules. I’m a 15-year-old high school student from France, and I’m teaching myself how to build and train open-source language models.
</div>
<div>
 <br>
</div>
<div>
 After saving money for several months, I bought an NVIDIA Jetson Orin Nano Super with only 8GB of memory. Despite the hardware limitations, I used it to learn the full process of developing a language model: preparing data, designing the architecture, training, evaluating, optimizing, and publishing the result.
</div>
<div>
 <br>
</div>
<div>
 I have now released my first model, G0-nano-instruct, publicly on Hugging Face:
</div>
<div>
 <br>
</div>
<div>
 <a href="https://huggingface.co/AZERDSQ/G0-nano-instruct" target="_blank" class="" rel="nofollow noopener noreferrer">https://huggingface.co/AZERDSQ/G0-nano-instruct</a>
</div>
<div>
 <br>
</div>
<div>
 G0 has 63 million parameters. It is a small first model, but it proved that I could complete the entire development pipeline independently on very limited hardware.
</div>
<div>
 <br>
</div>
<div>
 I am now preparing the next generation of the project, G1. Depending on the compute available, I am targeting a model between approximately 300 million and 2 billion parameters.
</div>
<div>
 <br>
</div>
<div>
 My current Jetson is no longer powerful enough for the experiments I want to run. My goal is therefore to raise enough money to purchase an NVIDIA DGX Spark, or an equivalent system based on the NVIDIA GB10 chip with 128GB of unified memory.
</div>
<div>
 <br>
</div>
<div>
 This machine would give me a permanent local environment where I could:
</div>
<div>
 <br>
</div>
<div>
 - train and fine-tune larger open-source models;
</div>
<div>
 - test new architectures and datasets;
</div>
<div>
 - publish benchmarks, checkpoints, and technical findings;
</div>
<div>
 - document both successful and failed experiments;
</div>
<div>
 - make the resulting models available publicly.
</div>
<div>
 <br>
</div>
<div>
 The fundraising target is approximately €5,000, covering the machine and the initial costs required to operate the project. If the full target is not reached, the funds will instead be used for cloud GPU compute, storage, and smaller-scale training experiments.
</div>
<div>
 <br>
</div>
<div>
 I will document the use of the funds and the development process publicly. This includes training configurations, compute costs, benchmarks, results, limitations, and failures.
</div>
<div>
 <br>
</div>
<div>
 Because I am under 18, the fundraiser and withdrawal of funds will be managed with the involvement of a parent or legal guardian.
</div>
<div>
 <br>
</div>
<div>
 Any support, contribution, technical advice, or introduction to a hardware partner would help me continue learning and building.
</div>
<div>
 <br>
</div>
<div>
 Thank you for supporting independent, open-source AI development.
</div>
<div>
 <br>
</div>
<div>
 Jules
</div>
<div>
 <br>
</div>
<div>
 Hugging Face:
</div>
<div>
 <a href="https://huggingface.co/AZERDSQ" target="_blank" rel="nofollow noopener noreferrer"><a href="https://huggingface.co/AZERDSQ" target="_blank" class="" rel="nofollow noopener noreferrer">https://huggingface.co/AZERDSQ</a></a>
</div>

Piotr Andruszkow

Teunis Mulder

Help Me Build G1 on a DGX Spark

platform

Platform is iOS

Android

Adyen Google Pay Development Audience

$opt_dummy_attribute

English only

Deprecate Stripe Legacy

dyn_template_ids

Adyen V6 Bene Transfer & MyMoney Campaign Organizers - test01

Bene transfer V6 and AdyenV6MyMoney Campaign Organizers - production

OneTrust next-app audience

fundCountryCode

NextDoor Share Option Users

Fundraisers with Reactions feature capability

fundCurrencyCode

US + Non-charity COs Only

locale

fund country is US and user language is English

personId

comms-internal-person-ids

Enhanced Story Experience Users

Suggested Goal Experience Users

user language is English and fund country: US, AU, DK, FI, IE, NO, SE, CA, GB; 

Poster share - new funds eligible (newest 9/18)

Streaming widgets beta user

paymentProcessor

3DS payment method

user language is English and fundCountry: US, AU, DK, FI, IE, NO, SE, CA, GB; 

currencyCode

Money Box Donation List Prompt Experiment Audience

GoFundMe Employees

ipAddress

Mark Rieth IP Address

Version 9.2.0 and above

Fund is in English speaking country

desktop

Android v12.11.0 and above

Platform is Android

paymentMethodType

checkoutType

Payment method type group to be vaulted on success

admin pr kit prod

EUR Donation Upsell

Share Text generation Skip Fundraiser

(prod) new funds eligible for amp12 (UGC gallery)

fintrac_cad_idv_form_v2 audience

paymentProcessorAccountId

fallback mode accounts

proCampaignId

p2p legacy startfundraising page

AMP24 New Funds Only PROD (DO NOT MODIFY)

countryCode

charityId

UKCharities

Federated Search Internal Testing

route.pathname community

US Donation Upsell audience 

Auto Thanks Feature Audience

Supporter Comments Eligible Funds

International Only

fundId

braze fundraiser group 

Payment Identity Transfers ATO Risk Check (Targeted) - Production

Fundraiser Saved Payment Method Rate Limit Bypass (Production)

leaderboard-partner-id-audience-givepanel

Version 9.2.1 and above

AUD Donation Upsell audience

fundraiserCountryCode is US/EN

Active Fundraiser - Smart Default Cadence

DAF Internal

Vault on success card payment method

Platform is iOS v11.0.0 and above

Desktop users

Person ids

United States (US) users

allow yuno fundraisers for test

Mexico country code

Posters INTL

NPO Profile Opted-In

iOS at or above 12.4.0

non-US recurring donors

Canada Campaign Owner Group

Fundraiser Without Meta Link

Scheduler payment tester gorup

charityCommunityId

Charities allow to be claimed unclaimed (PRD)

Canada (CA) users

UC Tipping v20250115 International

pymk_production_xplr_fe_team

Android at or above 12.2.0

Profile photo entry point audience

smart goals (fundraiser/manage) on test01

Activity Tracking v1 Beta Testing

start gfm intl allowed locales

Platform is iOS v11.2.0 and above

NPO upsell education category

unclaimed charities

prod_ach_audience

AI Chatbot Audience

amp13 only new funds (prod) (anyword auto)

UC Flow Enabled (Prod)

Payment Identity Beneficiary Verification - Production

shared notification bell audience

Custom users

ach frontend audience

Android v11.0.0 and above

Users Receiving Payments Paused Notifications

smart goals test01

Manage Coach - US English Organizers Only + new funds only

Team EGG - IP Address list

NPO recommendations prod

Fundraiser Without Instagram Deep Link

Native 11.4.0 and above

UC Tipping v20250107

Users Receiving Braze KYC Validation Failed

Native 11.3.0 and above

ai_title_page

anyword

openai

control

manual_entry

userEmail

template_id

userId

fundUrl

isCharityCo

email

appVersion

shouldBucketIntoExperiment

partnerId

donationCadence

isActiveFundraiser

isPartner

isMobile

npoProfileOptIn

fundIsLinkedWithMeta

hasSessionDonation

categoryGroup

isCampaignOwner

fundHasInstagramDeepLink

Native 11.4.0 and higher

New funds eligible - Video Sharing (PROD)

GB Donation Upsell audience 

Auto Thanks V3 Rollout Audience

Thank you V3 testing whitelist

isRecurringFriendly

Is Recurring Friendly

Excluded funds - Video Sharing

NPO upsell animals category

NPO upsell disaster relief category

Logged In Users

CH Donation Upsell audience

Android v10.6.0 and above

NPO upsell essential needs category

NPO upsell medical category

userCurrencyCode

Localized Currency

NPO upsell cancer category

v11.5.0 and above

testAudience

pathname

Survicate

appVersion is at or above 12.8.0

Non-charity fund

isChallengeFundraiser

challenge-fundraisers

Payment Identity Launch Verification - Production

New funds eligible - Posters v2

CAD Donation Upsell Audience

Braze Email Tester

NPO Profile Opted-Out

iOS App Version

hasKnownDonors

PYMK has donors

iOS v12.3.0 and above

Help Me Build G1 on a DGX Spark

Still €1,575 to go. Help us build momentum.