PeterAdel commited on
Commit
d599947
·
verified ·
1 Parent(s): 9385fe5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +144 -11
README.md CHANGED
@@ -1,16 +1,149 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
- base_model: unsloth/deepseek-r1-distill-qwen-14b-unsloth-bnb-4bit
3
- tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - qwen2
8
- - trl
9
- license: apache-2.0
10
- language:
11
- - en
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  # Uploaded model
15
 
16
  - **Developed by:** PeterAdel
@@ -19,4 +152,4 @@ language:
19
 
20
  This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
+ ---
2
+ base_model: unsloth/deepseek-r1-distill-qwen-14b-unsloth-bnb-4bit
3
+ tags:
4
+ - text-generation-inference
5
+ - transformers
6
+ - unsloth
7
+ - qwen2
8
+ - trl
9
+ - ai
10
+ - finetune
11
+ license: apache-2.0
12
+ language:
13
+ - en
14
+ ---
15
+
16
+
17
+ # CyberBrain_Model
18
+ <p align="center">
19
+ <img src="https://capsule-render.vercel.app/api?type=waving&height=120&color=244b6c&text=Cyper%20Brain&section=header&textBg=false&animation=twinkling&fontColor=a5241b&strokeWidth=0&rotate=0&reversal=false" style="width:100%;">
20
+ </p>
21
+ CyberBrain_Model is an advanced AI project designed for fine-tuning the model `unsloth/DeepSeek-R1-Distill-Qwen-14B` specifically for cyber security tasks. This repository provides tools and scripts for training and fine-tuning large language models efficiently using minimal hardware resources. The goal is to adapt the model for ethical cyber security applications, making it efficient even on devices with limited computational power, whether you have a low-end CPU or a GPU with limited VRAM.
22
+
23
+ In this project, we use technical content extracted from various cyber security sources as our primary training data. The raw text is processed into instruction-response pairs tailored for fine-tuning the model on cyber security scenarios. You can access the training data [here](./DataSet).
24
+
25
+ ![AI Training](assest/ai.jpg)
26
+
27
+ ## 📦 Project Structure
28
+
29
+ ```
30
+ assest/ # Assets, images, and other media files
31
+ Configure_Training_Arguments.py # Script for configuring training arguments
32
+ DataSet/ # Directory containing dataset files
33
+ Load_DataSet.py # Script to load the dataset
34
+ LoRA_Configuration.py # Script for LoRA configuration
35
+ map.md # Documentation about mapping
36
+ Model_Loading_with_Unsloth.py # Script to load the model using Unsloth
37
+ README.md # This file
38
+ requirements.txt # Required dependencies for the project
39
+ Table-Ways.md # Documentation about table ways
40
+ Train_Start.py # Script to start training the model
41
+ ```
42
+
43
+ ## 🚀 Installation
44
+
45
+ ### 1. Clone the Repository
46
+
47
+ ```bash
48
+ git clone https://github.com/YourUsername/CyberBrain_Model.git
49
+ cd CyberBrain_Model
50
+ ```
51
+
52
+ ### 2. Set Up the Environment
53
+
54
+ Create a new virtual environment (Python 3.11 is recommended):
55
+
56
+ ```bash
57
+ python -m venv .env
58
+ # Activate the environment:
59
+ # On Linux/Mac:
60
+ source .env/bin/activate
61
+ # On Windows:
62
+ .env\Scripts\activate
63
+ ```
64
+
65
+ ### 3. Install Required Dependencies
66
+
67
+ ```bash
68
+ pip install --upgrade pip
69
+ pip install -r requirements.txt
70
+ pip install torch==2.5.1+cu118 --index-url https://download.pytorch.org/whl/cu118
71
+ pip install torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
72
+ ```
73
+
74
+ ## 🤖 Running the Project
75
+
76
+ - **Model Loading:** Run `Model_Loading_with_Unsloth.py` to load the model.
77
+ - **Training:** Run `Train_Start.py` to start the fine-tuning process.
78
+ - **Configurations:** Review `LoRA_Configuration.py` and `Configure_Training_Arguments.py` for training settings.
79
+
80
+ ## 📄 Additional Documentation
81
+
82
+ Refer to the following files for more details:
83
+ - `map.md`
84
+ - `Table-Ways.md`
85
+
86
  ---
87
+
88
+ ## 🚀 Quick Start on Google Colab
89
+
90
+ To quickly run CyberBrain_Model on Google Colab, follow these steps:
91
+
92
+ 1. **Open a New Colab Notebook**
93
+ Click [here](https://colab.new/) to open a new Colab notebook in your browser.
94
+
95
+ 2. **Clone the Repository**
96
+ In your Colab notebook, run:
97
+ ```bash
98
+ !git clone https://github.com/YourUsername/CyberBrain_Model.git
99
+ %cd CyberBrain_Model
100
+ ```
101
+
102
+ 3. **Install Dependencies**
103
+ Install the required packages by running:
104
+ ```bash
105
+ !pip install --upgrade pip
106
+ !pip install -r requirements.txt
107
+ !pip install torch==2.5.1+cu118 --index-url https://download.pytorch.org/whl/cu118
108
+ !pip install torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
109
+ ```
110
+
111
+ 4. **Open and Run `main.ipynb`**
112
+ Open the `main.ipynb` notebook in Colab. This notebook provides a step-by-step guide to:
113
+ - Load the dataset from the `DataSet` directory.
114
+ - Load the model using `Model_Loading_with_Unsloth.py`.
115
+ - Configure training arguments via `Configure_Training_Arguments.py`.
116
+ - Start training using `Train_Start.py`.
117
+ - Evaluate the model and monitor training progress.
118
+
119
  ---
120
 
121
+ ## License
122
+
123
+ This project is licensed under the MIT License – see the [LICENSE](LICENSE) file for details.
124
+
125
+ ## Contact
126
+
127
+ For questions or contributions, feel free to open an issue or contact us directly through GitHub.
128
+
129
+ - Portfolio: [peteradel.netlify.app](https://peteradel.netlify.app)
130
+ - LinkedIn: [linkedin.com/in/1peteradel](https://linkedin.com/in/1peteradel)
131
+
132
+ ## ⭐ Give a Star
133
+
134
+ If you find this project useful or interesting, please give it a star! Your support helps improve the project and motivates further development.
135
+
136
+ ![AI Training](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExcXNhdWQzZWM0NzB6ZzRxcHZvdmxmMHJ3OWIwZ3RnZDY1dGJjZ3MxaSZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/H1eVHxFk781UxUNMul/giphy.gif)
137
+
138
+ ---
139
+
140
+ 🤍 Thank you for checking out **CyberBrain_Model**! Happy training!
141
+
142
+ <p align="center">
143
+ <img src="https://capsule-render.vercel.app/api?type=waving&color=gradient&height=65&section=footer"/>
144
+ </p>
145
+
146
+ ---
147
  # Uploaded model
148
 
149
  - **Developed by:** PeterAdel
 
152
 
153
  This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
154
 
155
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)