Hugging Face's logo

Delta-Vector
/
Hamanasu-4B-PT

Safetensors
llama
roleplay
finetune
storywriting
Model card Files
xet
Community
Delta-Vector commited on
Commit
03c862b
·
verified ·
1 Parent(s): 6378947

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +271 -0
README.md ADDED
@@ -0,0 +1,271 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ thumbnail: "https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/jg2NWmCUfPyzizm2USjMt.jpeg"
3
+ datasets:
4
+ - Mielikki/Erebus-87k
5
+ - NewEden/Orion-Asstr-Stories-16K
6
+ - NewEden/Orion-LIT
7
+ - NewEden/Fujin-Cleaned-Final
8
+
9
+ base_model:
10
+ - IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml
11
+ tags:
12
+ - llama
13
+ - roleplay
14
+ - finetune
15
+ - storywriting
16
+ ---
17
+ <!DOCTYPE html>
18
+ <style>
19
+ html, body {
20
+ background: black;
21
+ color: #c9d1d9 !important;
22
+ font-family: 'Segoe UI', Tahoma, Geneva, Verdana, sans-serif;
23
+ margin: 0;
24
+ padding: 0;
25
+ min-height: 100vh;
26
+ }
27
+ .markdown-body {
28
+ color: white;
29
+ margin: 40px auto;
30
+ padding: 40px;
31
+ border-radius: 12px;
32
+ position: relative;
33
+ overflow: hidden;
34
+ }
35
+
36
+ .markdown-body::after {
37
+ content: '';
38
+ position: absolute;
39
+ top: 0;
40
+ left: 0;
41
+ width: 100%;
42
+ height: 100%;
43
+ background: #0c0f18; /* background color */
44
+ pointer-events: none;
45
+ z-index: -999;
46
+ }
47
+
48
+ h1, h2, h3 {
49
+ background: linear-gradient(45deg, #6e00ff, #00ffff);
50
+ -webkit-background-clip: text;
51
+ -webkit-text-fill-color: transparent;
52
+ border-bottom: 1px solid #333;
53
+ padding-bottom: 0.3em;
54
+ }
55
+
56
+ div[style*="border:2px solid #333"],
57
+ div[style*="border: 2px solid #333"],
58
+ div[style*="border:1px solid #333"],
59
+ div[style*="border: 1px solid #333"] {
60
+ background: rgba(22, 27, 34, 0.8) !important;
61
+ border: 2px solid #6e00ff !important;
62
+ box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);
63
+ border-radius: 10px;
64
+ padding: 20px;
65
+ margin: 20px 0;
66
+ }
67
+
68
+ code {
69
+ background-color: #1a1a1a !important;
70
+ border-radius: 4px;
71
+ padding: 0.2em 0.4em;
72
+ color: #00ffff;
73
+ }
74
+
75
+ pre {
76
+ background-color: #1a1a1a !important;
77
+ border: 1px solid #333;
78
+ border-radius: 8px;
79
+ padding: 16px;
80
+ }
81
+
82
+ table {
83
+ width: 100%;
84
+ border-collapse: collapse;
85
+ margin: 20px 0;
86
+ background: rgba(0,0,0,0.2);
87
+ table-layout: fixed;
88
+ color: white;
89
+ }
90
+
91
+ th, td {
92
+ border: 1px solid #333;
93
+ padding: 12px;
94
+ text-align: center;
95
+ color: white;
96
+ }
97
+
98
+ th {
99
+ background: rgba(110, 0, 255, 0.1);
100
+ }
101
+
102
+ td:nth-child(1) {
103
+ width: 1%;
104
+ white-space: nowrap;
105
+ }
106
+
107
+ td:nth-child(2) {
108
+ width: 100%;
109
+ }
110
+
111
+ td > span {
112
+ display: block;
113
+ padding: 4px 8px;
114
+ background: rgba(110, 0, 255, 0.1);
115
+ border-radius: 4px;
116
+ transition: all 0.3s ease;
117
+ }
118
+
119
+ td > span:hover {
120
+ background: rgba(110, 0, 255, 0.2);
121
+ transform: translateY(-1px);
122
+ }
123
+
124
+ a {
125
+ color: #00ffff;
126
+ text-decoration: none;
127
+ transition: all 0.3s ease;
128
+ }
129
+
130
+ a:hover {
131
+ color: #6e00ff;
132
+ text-decoration: none;
133
+ }
134
+
135
+ hr {
136
+ border: 0;
137
+ height: 1px;
138
+ background: linear-gradient(90deg, transparent, #333, transparent);
139
+ margin: 40px 0;
140
+ }
141
+
142
+ img {
143
+ max-width: 100%;
144
+ border-radius: 10px;
145
+ }
146
+
147
+ details summary:hover {
148
+ color: #00ffff;
149
+ }
150
+
151
+ * {
152
+ color-scheme: dark !important;
153
+ }
154
+
155
+ .prose, .max-w-none, .px-4 {
156
+ background-color: transparent !important;
157
+ color: #c9d1d9 !important;
158
+ }
159
+ </style>
160
+ <body>
161
+ <div class="markdown-body">
162
+ <div align="center">
163
+
164
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/o5WjJKA9f95ri9UzRxZQE.png" alt="Model Visualization" width="500px" style="border: 3px solid #333; box-shadow: 0 0 15px rgba(66, 0, 131, 0.5);" />
165
+
166
+ <br>
167
+ <br>
168
+
169
+ <div style="font-size:1.5em; font-weight:bold; background: linear-gradient(45deg, #6e00ff, #00ffff); -webkit-background-clip: text; -webkit-text-fill-color: transparent;">
170
+ Hamanasu 4B
171
+ </div>
172
+
173
+ </div>
174
+
175
+ <div style="border:1px solid #333; border-radius:10px; padding:20px; margin:20px 0; background: rgba(0,0,0,0.4);">
176
+
177
+
178
+ ## 🌌 Overview
179
+
180
+ <i>This model is a finetune of Llama-3.1-Minitron-4B-Width-Base-chatml on 1B tokens of Stories & Books </i>
181
+
182
+ <i>This model is not usable for Chat.</i>
183
+
184
+ <i>All thanks to Tav for funding the train.</i>
185
+
186
+ </div>
187
+
188
+ <div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(250px, 1fr)); gap: 20px; margin: 20px 0;">
189
+
190
+
191
+ <div style="border:2px solid #333; border-radius:10px; padding:20px; background: rgba(0,0,0,0.2);">
192
+
193
+ ### ⚔️ Hardware
194
+ - 8x H100s
195
+ - Epochs: 1
196
+ - Base: `IntervitensInc/Llama-3.1-Minitron-4B-Width-Base-chatml`
197
+ </div>
198
+
199
+ </div>
200
+
201
+
202
+ <div style="border: 2px solid #6e00ff; border-radius: 10px; padding: 20px; margin: 20px 0; box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);">
203
+
204
+ ## Axolotl Config ꒰(˶• ᴗ •˶)꒱
205
+
206
+ <details>
207
+
208
+ ```yaml
209
+ https://wandb.ai/new-eden/tavbussy/artifacts/axolotl-config/config-jpgzpr2g/v0/files/axolotl_config_3y5zkvbz.yml
210
+ ```
211
+
212
+ </details>
213
+ </div>
214
+
215
+ <div align="center">
216
+
217
+ <div style="border: 2px solid #6e00ff; border-radius: 10px; padding: 20px; margin: 20px 0; box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);">
218
+
219
+ ## ⚡ Credits
220
+ <div style="display: flex; justify-content: center;">
221
+ <div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(200px, 1fr)); gap: 10px; margin: 20px 0; max-width: 600px;">
222
+
223
+ <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
224
+ <a href="https://huggingface.co/lucyknada">
225
+ <img src="https://img.shields.io/badge/%F0%9F%8C%9F-Lucy_Knada-blueviolet" alt="Lucy Knada">
226
+ </a>
227
+ </div>
228
+
229
+ <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
230
+ <a href="https://huggingface.co/hamanasu">
231
+ <img src="https://img.shields.io/badge/%E2%9A%94%EF%B8%8F-jeiku-blueviolet" alt="Ruka">
232
+ </a>
233
+ </div>
234
+
235
+ <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
236
+ <a href="https://huggingface.co/intervitens">
237
+ <img src="https://img.shields.io/badge/%F0%9F%9B%A1%EF%B8%8F-Intervitens-blueviolet" alt="Intervitens">
238
+ </a>
239
+ </div>
240
+
241
+ <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
242
+ <a href="https://huggingface.co/kalomaze">
243
+ <img src="https://img.shields.io/badge/%F0%9F%94%AE-Kalomaze-blueviolet" alt="Kalomaze">
244
+ </a>
245
+ </div>
246
+
247
+ <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
248
+ <a href="https://huggingface.co/kubernetes-bad">
249
+ <img src="https://img.shields.io/badge/%E2%9A%A1-Kubernetes_Bad-blueviolet" alt="Kubernetes Bad">
250
+ </a>
251
+ </div>
252
+
253
+ <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
254
+ <a href="https://huggingface.co/anthracite-org">
255
+ <img src="https://img.shields.io/badge/%F0%9F%8C%91-Anthracite-blueviolet" alt="Anthracite">
256
+ </a>
257
+ </div>
258
+ </div>
259
+ </div>
260
+ </div>
261
+
262
+ ---
263
+
264
+ <div align="center">
265
+ <div style="font-size:0.8em; opacity:0.8;">Made by</div>
266
+ <div style="font-size:1.2em; font-weight:bold; background: linear-gradient(45deg, #6e00ff, #00ffff); -webkit-background-clip: text; -webkit-text-fill-color: transparent;">Delta-Vector</div>
267
+ </div>
268
+
269
+ </div>
270
+ </body>
271
+ </html>