Sinipelto
/
banan-os
forked from Bananymous/banan-os
1
0
Fork 0
Code Pull Requests Activity
1,006 Commits 1 Branch 0 Tags 3.9 MiB
Commit Graph

671 Commits

Author SHA1 Message Date
Bananymous 54d981120d Kernel: kmalloc debug_dump is marked [[maybe_unused]] 2023-05-26 22:31:21 +03:00
Bananymous f79250c4d4 LibC: Rewrite all the headers. 
We now have more or less posix issue 2018 conforming libc headers.

This was a really time consuming and boring operation but it had to
be done.

Now we get to actually start implementing libc :)
 2023-05-26 22:31:21 +03:00
Bananymous 0ab3332ad3 Userspace: Start work on shell 2023-05-26 22:31:21 +03:00
Bananymous 9e0abbc2f0 Kernel: Add bareboness possibility to set termios 2023-05-26 22:31:21 +03:00
Bananymous 4a4a3bf184 Kernel/LibC: move file offset back to kernel 
This makes keeping track of offsets easier and more proper
 2023-05-26 22:31:21 +03:00
Bananymous f33e78882e Kernel: Add argc and argv to process entry 2023-05-16 00:27:49 +03:00
Bananymous 0ff067bdb7 Kernel: Add MMUScope 
This disables interrupts and loads specified mmu for the
scope it lives in
 2023-05-16 00:26:39 +03:00
Bananymous 31ac3260ed Kernel: MMU keeps track of the current 2023-05-16 00:26:39 +03:00
Bananymous 85039020d3 Kernel: argc is passed as zero to userspace 2023-05-11 18:28:32 +03:00
Bananymous 7eb43990ad BuildSystem: userspace has cmake target 2023-05-11 16:19:53 +03:00
Bananymous 53f4b5a9da LibC: add function declarations to sys/stat.h 2023-05-11 15:11:33 +03:00
Bananymous 1cf7ef3de6 Kernel: Remove offset from OpenFileDescriptor 
This is now handled on the libc side. There might be reasons to
have it in kernel side, but for simplicity's sake I'm moving it
to libc for now :)
 2023-05-09 20:31:22 +03:00
Bananymous 812e61ca70 Kernel: Add barebones GeneralAllocator for >4096B 2023-05-08 22:10:49 +03:00
Bananymous 2d0a5a9e15 Kernel: FixedWidthAllocator operates on MMU 
Instead of Process* we use MMU& in FixedWidthAllocator since it is
everything it actually needs :)
 2023-05-08 00:06:56 +03:00
Bananymous f32d594879 Kernel: We add FixedWidthAllocators on demand 
On SYS_ALLOC we will add a new FixedWidthAllocator if the old ones
are already full or we don't have one with proper size. This allows
arbitary number of allocations as long as you have enough memory
available :)

Next I will be writing a general allocator for allocations larger
than 4096 bytes which should make SYS_ALLOC syscall complete :)
 2023-05-07 23:57:01 +03:00
Bananymous 2fe9af7165 Kernel/LibC: add free function for FixedWidthAllocator 
I have to rework the syscall API and allocators in process. For
now this works well enough :)
 2023-05-07 01:21:50 +03:00
Bananymous 0deda83d05 BuildSystem: linker -O2 doesn't do anything? hopefully 2023-05-06 19:58:08 +03:00
Bananymous ff5bcd4416 Kernel: Add basic fixed width allocator for userspace 
We have to move process stacks to the general heap and maybe map
kernel to higher half.
 2023-05-06 19:58:08 +03:00
Bananymous b65cd1d09b Kernel: Invalid physical addresses from heap are specified now by 0 2023-05-06 17:34:22 +03:00
Bananymous bc35a561d3 Kernel: GDT tss selector is now 16 bit value 2023-05-06 17:34:22 +03:00
Bananymous 06bc807e34 Kernel: MMU can now provide info about virtual address space 2023-05-06 17:34:22 +03:00
Bananymous 6262e41de1 Kernel: ISRs now print pid and tid 2023-05-06 00:10:15 +03:00
Bananymous 0cb53efa01 Kernel: 64 bit MMU now properly identity maps kernel 2023-05-05 14:19:28 +03:00
Bananymous 4e859bedbc Kernel: TTY input process is now single instance 
Process sends key events to the active (currently only) tty
 2023-04-30 16:11:14 +03:00
Bananymous f139fc2229 Kernel: namespace and function renames 
MMU moved to namespace kernel
Kernel::Memory::Heap moved to just Kernel
MMU::map_{page,range} renamed to identity_map_{page,range}

Add MMU::get_page_flags
 2023-04-28 14:48:38 +03:00
Bananymous e48acbb03b Kernel: Add set_tss_stack() to 32 bit 2023-04-28 14:44:23 +03:00
Bananymous d1155c968e Kernel: dprintln file name is now relative 
This makes file names much shorter
 2023-04-28 14:43:19 +03:00
Bananymous 46dcf98fc1 Kernel: Scheduler updates tss stack on thread execution 2023-04-25 14:49:50 +03:00
Bananymous 58ce907327 Kernel: Usespace threads now have an interrupt stack 2023-04-25 14:49:18 +03:00
Bananymous 6ecc8cac0e Kernel: TSS stack can be set after initialization 2023-04-25 14:48:12 +03:00
Bananymous bd95f17426 Kernel: Stack pointer out of bounds now panics with a message 2023-04-25 13:40:55 +03:00
Bananymous 175f07cd2f Kernel: Fix bug in Process::create_userspace() 
We used to write more than we needed to. This could lead to unwanted
page faults
 2023-04-25 13:21:28 +03:00
Bananymous 77c83e5552 Kernel: Fix possible dead lock in Process::read() 2023-04-23 14:46:18 +03:00
Bananymous b15deb420f LibC: Write mostly functioning stdio 2023-04-23 14:32:37 +03:00
Bananymous b38989d594 Kernel: Add ASSERTion to Process::exit() 
This is just so I don't forget that exit can currently only
be called on the executing thread itself
 2023-04-22 19:05:27 +03:00
Bananymous 79e6de325f Kernel: Process can now load 32 bit elf files on i386 
We are page faulting on process exit but I'm investigating
the reason.
 2023-04-22 19:03:30 +03:00
Bananymous 4f8f3ddc29 Kernel: Fix 32 bit MMU 2023-04-22 18:22:39 +03:00
Bananymous 82a1a29260 Kernel: More proper paging in Elf loading 2023-04-22 18:17:44 +03:00
Bananymous 8a5608df91 Kernel: d{print,warn,error}ln(...) now has a spinlock 2023-04-22 17:58:51 +03:00
Bananymous 3f1c0ec91b Kernel: Process now frees up its pages on destruction 2023-04-22 16:54:46 +03:00
Bananymous 1406a75a92 Kernel: Cleanup process creation for userspace 2023-04-22 16:51:50 +03:00
Bananymous 8001493df3 Kernel: Fix some deadlocks in the Process 2023-04-22 16:19:57 +03:00
Bananymous 8c1f5bfe1e Kernel: Remove obsolete userspace stuff from kernel 2023-04-22 15:38:45 +03:00
Bananymous ec8b9640e2 Kernel: Usespace programs are now ran through ELF files 
only 64 bit elf files are supported for now.
 2023-04-22 15:35:32 +03:00
Bananymous d9068eebb5 Kernel: kmalloc does not dump stack trace 
dump_stack_trace() page faults and i dont feel like debugging this
now :)
 2023-04-21 13:45:13 +03:00
Bananymous 3ad0d2328d Kernel: Don't call 'cli' on interrupt 
This is automatically done because we are using interrupt gates
in the IDT
 2023-04-21 11:18:08 +03:00
Bananymous 3f2beb4547 Kernel: Fix syscall return value in 32 bit 2023-04-21 11:08:02 +03:00
Bananymous be14a6c239 Kernel: Stack pointer is validated when updated 
This allows us not to fail stack pointer when in syscall since
interrupts use their own stack
 2023-04-21 10:40:24 +03:00
Bananymous 3aa0eeb4a3 Kernel: Add barebones per process virtual addresses 
We now assign every (userspace) process its own MMU which we load
in scheduler. This allows every process to have separate virtual
address space.

This is very hackish implementations but it works for now
 2023-04-20 00:45:41 +03:00
Bananymous b3eeb6412f Kernel: Add some bareboness functionality to map virtual addresses 2023-04-19 23:51:36 +03:00
Bananymous d38470c8e2 Kernel: Rename MMU::{un,}allocate... to MMU::{un,}map 
This is more appropriate name for the behaviour :D
 2023-04-19 21:50:30 +03:00
Bananymous a159c980ee Kernel: kmalloc will always print debug on failed alloc 2023-04-19 18:05:01 +03:00
Bananymous 4475e3e184 Kernel: ATAController will fail to initialize in native mode 2023-04-19 17:29:36 +03:00
Bananymous cf0320e47d Kernel: PCI devices now report their prog_if 2023-04-19 16:43:05 +03:00
Bananymous cd03a95128 Kernel: Shell fix file reading 
We were reading 8 bytes at a time instead of the 1024 we were
supposed to :DD
 2023-04-19 14:09:23 +03:00
Bananymous 51e299c7e3 Kernel: Shell now has exit() command 2023-04-19 12:53:09 +03:00
Bananymous 6f65453fd4 Kernel: Fix Process::exit() and where it is called from 
cksum doesn't seem to work anymore on big files. I have to look
into this. It locks up after couple of seconds...
 2023-04-19 12:52:21 +03:00
Bananymous d74ce4950c Kernel: We now launch Shell again on boot 
Adding this just before push :D
 2023-04-19 00:41:24 +03:00
Bananymous 59a682c720 Kernel: init2 is now launched as a process instead of thread 
Also only process can now add threads to scheduler. Nobody should
have raw access to scheduler and everything should be through
Process::current() or irqs (reschedules)
 2023-04-19 00:39:06 +03:00
Bananymous 7bd4593748 Kernel: Process is not reference counted any more 
This was not necessary and it made things needlessly complicated
 2023-04-19 00:34:18 +03:00
Bananymous 5494e2c125 Kernel: Heap allows us to take free pages. 
The API is kinda weird and will probably be reworked in near future
but this will work for now :)
 2023-04-18 10:18:15 +03:00
Bananymous aba82564f5 Kernel: Panic wont print stacktrace if it has already paniced 
This prevents stack trace dump to panic and loop
 2023-04-18 10:18:15 +03:00
Bananymous 93abee9c7c Kernel: Map all ACPI tables on initialization 
This makes their usage much easier and less error prone

They won't mapped be processes when we get to there, so this won't be
a problem
 2023-04-18 10:18:15 +03:00
Bananymous 821d065eba Kernel: Handle some Heap edge cases 2023-04-18 10:18:15 +03:00
Bananymous 2614437ba0 Kernel: Reorder boot initialization 
We now create the TTY as soon as possible so we can show console
output without serial port.
 2023-04-18 10:18:15 +03:00
Bananymous 1aac3a0425 Kernel: Heap implementation can now give free pages from all of RAM 2023-04-18 10:18:15 +03:00
Bananymous a4568f9263 Kernel: Remove unused file 2023-04-18 10:18:15 +03:00
Bananymous a180e72b6f Kernel: Start working on heap 2023-04-18 10:18:15 +03:00
Bananymous 2de64b592d Kernel: Kmalloc now has its memory statically allocated 
We don't use the memory map given by bootloader since this automatically
maps the memory to a available space.
 2023-04-18 10:18:15 +03:00
Bananymous 9c0f3dd996 Kernel: Move kmalloc and MMU to Memory directory 2023-04-18 10:18:15 +03:00
Bananymous 079df39ca8 LibELF: Start implementing elf library 2023-04-18 10:18:15 +03:00
Bananymous fe87c08a02 LibC: add needed stubs to build executables with our compiler 2023-04-12 17:53:02 +03:00
Bananymous 8637959289 Kernel: We can create basic userspace processes 
These are still allocated on the kernel memory
 2023-04-12 17:52:36 +03:00
Bananymous 6be53668b9 Kernel: Scheduler can now terminate processes threads 2023-04-12 17:49:04 +03:00
Bananymous d1b7249803 Kernel: Debug::dump_stack_trace now 'detects' repeating function 2023-04-12 01:32:41 +03:00
Bananymous ff7c50c627 Kernel: kmalloc does not check for corruptiong unless it cannot allocate 
We 'don't care' if kmalloc is corrupted unless it prevents us from
allocating memory. Scheduler should be catching stack overflows either
way and is much more efficient
 2023-04-12 00:24:02 +03:00
Bananymous 12779cdef8 Kernel: Threads now use only 4 KiB stack :) 2023-04-12 00:22:08 +03:00
Bananymous f5e676b2b7 Kernel: Fix TTY spinlock usage 2023-04-12 00:20:04 +03:00
Bananymous 8e5e5f819f Kernel: Shell TTY_PRINT is now function instead of macro 
This makes functions uses way less stack
 2023-04-12 00:18:58 +03:00
Bananymous 370a958379 BuildSystem: GCC will now complain on functions with 1 KiB stack 2023-04-12 00:18:06 +03:00
Bananymous a0bd3dc54f Kernel: kmalloc now detects corruption 
Kmalloc checks if its nodes have corrupted. This was happening
because of stack overflow.
 2023-04-11 23:36:46 +03:00
Bananymous 809eb2fe3e Kernel: Mark Scheduler::start() as noreturn as appropriate 2023-04-11 23:33:20 +03:00
Bananymous 7010d8614f Kernel: kernel doesn't allocate large blocks of data on stack 
We used to allocate 1 KiB blocks on multiple places on stack. This
is a problem, since kernel stack shouldn't have to be too big
 2023-04-11 23:31:58 +03:00
Bananymous 69f13f1896 Kernel: Scheduler will panic if it encounters stack overflow 2023-04-11 23:29:21 +03:00
Bananymous bdaf7cddcb Kernel: Process now locks the mutex while modifying open files 
This allows processes to be actually removed from the list instead
of dead locking
 2023-04-11 23:28:16 +03:00
Bananymous 8d6db168d6 Kernel: remove message from BAN::Error 
We don't store the error message anymore in BAN::Error.
Instead we store a error code that can be mapped into a string.
This allows BAN::Error to only take 4 bytes instead of 128.

We should also make some kernel initialization just panic instead
of returning errors since they are required for succesfull boot
anyway.
 2023-04-11 23:25:21 +03:00
Bananymous 2fabe1949c BAN: Move RefPtr to its own file and create New.h 
New.h contains definitions for placement new operators and
BAN::allocator and BAN::dealloctor
 2023-04-10 21:07:25 +03:00
Bananymous c660df14ec BuildSystem: Fix header copying to sysroot 
We used to copy all headers everytime to sysroot which caused
rebuild of the whole os. Now we use the cmake command
'copy_directory_if_different' which seemed to fix this issue :)
 2023-04-10 21:07:25 +03:00
Bananymous e704968f96 Kernel: Threads can now be terminated mid execution 2023-04-10 21:07:25 +03:00
Bananymous 32359df939 Kernel: Add small wait in ATA driver before reading/writing 
This allows bochs to boot again
 2023-04-10 21:07:25 +03:00
Bananymous 641ed23380 Kernel: Fix framepointers on started threads 2023-04-10 21:07:25 +03:00
Bananymous 9f977488fa BuildSystem: cmake can now build out libc 
I can't seem to get libc++ build to work...
 2023-04-10 21:07:25 +03:00
Bananymous 7752b02fb7 BuildSystem: remove now obsolete include directories from kernel build 2023-04-07 02:25:47 +03:00
Bananymous f70cd3ea77 BuildSystem: Cleanup cmake code 
The buildsystem is kind of a mess. I will be writingn build
instructions soon.
 2023-04-06 20:31:10 +03:00
Bananymous 5db5ff069a BuildSystem: you can now build the toolchain with cmake 2023-04-06 00:23:02 +03:00
Bananymous e84f613c4d Kernel: Shell now somewhat functions again 
I will not be fixing the shell implementation until I get to
userspace
 2023-04-05 11:37:41 +03:00
Bananymous 5db4e5b4d5 Kernel: Fix TTY echo and canonical flag behaviour 2023-04-05 11:35:19 +03:00
Bananymous b00dd8d68d Kernel: Fix ansi control sequence cursor movement 2023-04-05 03:07:52 +03:00
Bananymous abbbf7ec15 Kernel: Add tty to process and make termios modifiable 2023-04-05 02:53:28 +03:00
Bananymous d0b1457f30 Kernel: TTY now supports clearing 2023-04-05 02:04:18 +03:00
Bananymous a423cd8bb3 Kernel: Add partial support for shell 
We don't handle arrow keys, and the tty does not know how to clear
the screeen :D
 2023-04-05 01:30:58 +03:00
Bananymous db076058b9 Kernel: Process can now initialize stdio 
This allows the use of the fds STD{IN,OUT,ERR}_FILENO
 2023-04-05 01:10:25 +03:00
Bananymous a1100624bf Kernel: Start work on making tty a file 
TTY is now a file that you can read from/write to. I still have
to port shell to use this new interface
 2023-04-05 00:56:09 +03:00
Bananymous 28e1497f88 Kernel: add virtual write function to inode 2023-04-03 20:29:07 +03:00
Bananymous 8d6111641e Kernel: Fix keys in PS2Keymap 2023-04-03 20:25:23 +03:00
Bananymous 3ee20d1a84 Kernel: Fix typo 2023-04-03 19:56:55 +03:00
Bananymous 002c2d0aca BuildSystem: remove non-existent file from kernel CMakeLists.txt 2023-04-03 19:02:25 +03:00
Bananymous 461a5774f8 Kernel: Device dev and rdev number is done more properly 
Also hd* partitions are now 1 indexed instead of 0
 2023-04-03 11:43:16 +03:00
Bananymous ebfd092075 Kernel: Cleaner partition parsing errors 2023-04-03 09:55:49 +03:00
Bananymous e322826347 Kernel: Optimize scheduler idling 
Now after each interrupt we will ask the scheduler to reschedule
if the current thread is the idle thread. This allows semaphore
unblocking to be practically instant when there is only one thread
executing.

Now disk reading is back to ~3 MB/s for single threaded process
 2023-04-03 01:51:05 +03:00
Bananymous 3998c5f955 Kernel: ATA now uses irqs instead of polling 
Reading is now much slower at ~500 kB/s it was around 3 MB/s.
This is probably mostly due semaphore blocking taking atleast
until next reschedule (1 ms itervals). This will be a problem
as long as we are using only single processor.

I could try to use {READ/WRITE}_MULTIPLE commands, but since
most of the disk reads are 2 sectors (inode block size) this
will at most double the speed.

Most efficient speed up would of course be caching disk access
data and inodes overall.
 2023-04-03 00:03:38 +03:00
Bananymous 762d22ed28 Kernel: Move ATADevice to its own file from ATAController 
The API is kinda weird since device reads/writes go from
ATADevice -> ATAController -> ATADevice
but this is for now atleast necessary since ATAController has(?)
to keep all devices from using the disks at the same time
 2023-04-02 18:26:19 +03:00
Bananymous f2362b2b78 Kernel: ATA controller waits now before read/write until disk is ready 
Qemu used to freeze on disk writes but now it seems fine
 2023-04-02 05:37:17 +03:00
Bananymous 471ac80420 BuildSystem: building for 32-bit works now 2023-04-02 05:03:17 +03:00
Bananymous e49d3c7bfe BuildSystem: We are now using cmake instead of plain make 
I have been annoyed for a while since I had to build everything
when running the os since the buildsystem was really bad.

I wanted to rewrite the whole build system and changed to using cmake

:)
 2023-04-02 04:07:27 +03:00
Bananymous 79090c2648 Kernel: cleanup includes 
I went quickly went through all files since I found some weird
includes :D
 2023-04-01 02:14:49 +03:00
Bananymous 7a6b1c8e47 Kernel: Fix traversing back from mount points 2023-04-01 01:54:35 +03:00
Bananymous 8988ce2766 Kernel: Add inodes '.' and '..' to device manager 2023-04-01 01:33:04 +03:00
Bananymous dcde2ae6b4 Kernel: Reads return 0 bytes read at the end of device 
We used to not have any idea if we where already at the end of device.
Also fixed couple of copy-paste errors from read->write
 2023-04-01 00:55:07 +03:00
Bananymous c62849a783 Kernel: Shell cleanup cat command 2023-04-01 00:54:39 +03:00
Bananymous f453e8e170 Kernel: Shell 'time' prints the time even if command fails 2023-04-01 00:30:33 +03:00
Bananymous 990887891e Kernel: Process gets absolute paths for mount 2023-04-01 00:30:11 +03:00
Bananymous 5da801d12b Kernel: fix ext2 failed creation memory leak 2023-04-01 00:22:03 +03:00
Bananymous 3a4557d417 Kernel: Cleanup ATA device initialization 2023-03-31 00:58:57 +03:00
Bananymous 26d9a3e253 Kernel: Move DeviceManager to its own file 2023-03-30 22:39:45 +03:00
Bananymous eef3631a5a Kernel: Improve locking in Process, VFS and ATAController 
We used to block on all process access. This meant that shell
reading the keyboard input would block all VFS access making disk
accesses practically impossible. We now block only when it is
necessary :)
 2023-03-30 22:02:16 +03:00
Bananymous 88ee35165f Kernel: Thread is no longer RefCounted 
This makes developement with Scheduler much easier against compiler
optimizations. I could now remove the pragma GCC optimize stuff.
 2023-03-30 19:16:51 +03:00
Bananymous c8f05b4a7a Kernel: Add Semaphore to block threads 2023-03-30 18:46:33 +03:00
Bananymous 2995a36942 Kernel: root partition is now passed from the commandline 2023-03-30 18:46:19 +03:00
Bananymous 3e8ab8271d Kernel: Shell can now mount partitions 2023-03-30 15:06:41 +03:00
Bananymous 5b3a00c64f Kernel: Inode::Mode is now a struct so we can have functions in it 2023-03-30 14:41:15 +03:00
Bananymous 0ce9fd8597 Kernel: StorageDevices and Controllers are now devices 2023-03-30 14:22:15 +03:00
Bananymous c9badb5a1c Kernel: Add IFBLK, IFLNK, IFSOCK to Inode::Mode 2023-03-30 13:15:46 +03:00
Bananymous a513bc5749 Kernel: All devices have atime, mtime, ctime at their creation 2023-03-30 13:15:46 +03:00
Bananymous 5d5487315f Kernel: Remove the mount test from VFS 2023-03-30 11:43:24 +03:00
Bananymous 3508df67b1 Kernel: fix stat command and device numbers 2023-03-30 10:43:08 +03:00
Bananymous 06ce1f0667 Kernel: Rewrite mounting code 2023-03-29 21:34:48 +03:00
Bananymous 1fb8c211f0 Kernel: Move Partition out of StorageDevice and rename functions 2023-03-29 13:23:01 +03:00
Bananymous 9c7670847e Kernel: Shell commands 'ls' and 'stat' recognize character devices 2023-03-29 11:56:33 +03:00
Bananymous a24c2d9be2 Kernel: DeviceManager is now a 'FileSystem' so it can expose devices 
Shell reads keyboard through /dev/input :)
 2023-03-29 11:50:46 +03:00
Bananymous 7f90079ea7 Kernel: Fix keymap numlock behaviour 2023-03-29 03:18:22 +03:00
Bananymous f4b4987d43 Kernel: Remove obsolete KeyboardLayout/ 
This was used by the old input system. Currently keyboard layout is
hardcoded to finnish. But it will be reworked as something read from
the filesystem
 2023-03-29 03:09:14 +03:00
Bananymous ac094a48d6 Kernel: Rework the whole input system 
We now use Device abstraction that will allow us to provide devices
to userspace through /dev. Currently Shell reads from first and only
device (it being PS/2 Keyboard).
 2023-03-29 03:05:16 +03:00
Bananymous f9a0412e78 Kernel: ACPI unmap_header does not do anything 
We have to work with MMU mapping/unmapping to be user friendly
 2023-03-28 02:56:44 +03:00
Bananymous 2f8c9746e3 Kernel: Move ACPI to its own file 2023-03-27 17:30:45 +03:00
Bananymous f8a2c60c8d Kernel/BAN: move unix time conversion to BAN and add stat to Shell 2023-03-27 00:49:58 +03:00
Bananymous 770f7716a0 Kernel: Rework processes and VFS so we don't expose inodes 
Everything is now done through a file descriptor.
 2023-03-26 04:30:57 +03:00
Bananymous d67de70126 Kernel: Process::working_directory() is now thread safe 
I realized you cannot return a stirng view and it to be thread safe
 2023-03-24 01:46:25 +02:00
Bananymous 6f334756c5 Kernel: Create RecursiveSpinLock and add it to Process 
We now lock every function within Proccess, just to be sure.
Recursive lock allows us to use lock from the same thread even if
we already have the spinlock locked
 2023-03-24 01:32:35 +02:00
Bananymous 310713d203 Kernel: Lock process functions instead of the ata controller 
Process has to use locks at least on some functions so multithreaded
disk io is safe. This seemed to fix corrupted reads from disk
 2023-03-24 01:17:39 +02:00
Bananymous 7d2ab53baa Kernel: Ext2FS now does allocations better 
We only have to allocate at the beginning of the all functions and
can properly exit before any disk reads if we run out of memory.

This makes development little bit 'harder' since the {read,write}_block
user must allocate a buffer of atleast block_size bytes.

I also made disk access to cause kernel panic on error since the error
handling during file write is something I don't want to think now.
The filesystem can easily corrupt so, I feel like when disk io starts
to fail I'll come back to this.
 2023-03-23 23:22:31 +02:00
Bananymous 2152b8b95f Kernel: Add possibiliity to create empty files on Ext2 
Big rewrite for Ext2 for more easy and optimized code
 2023-03-23 22:26:06 +02:00
Bananymous 4fd21bc303 Kernel: Remove block group descriptor cache from ext2fs 
This will make improving the fs easier since we need to only update
the values on the disk
 2023-03-23 18:52:58 +02:00
Bananymous 15037bfc7a Kernel: Move get_unix_time to RTC namespace 2023-03-23 18:14:51 +02:00
Bananymous 3572e9794a BAN: Modify Span constructors to keep constness correctly 2023-03-23 14:26:03 +02:00
Bananymous 6ed9651176 Kernel: StorageDevice and Ext2 "support" writing 2023-03-23 13:04:13 +02:00
Bananymous 3efbe22a1b Kernel: Shell now prints unix time with 'date' command 2023-03-23 11:13:51 +02:00
Bananymous 96579b88cf Kernel: Cleanup GPT parsing code 2023-03-23 11:13:14 +02:00
Bananymous 2ec18855f2 Kernel: TTY buffer is resized on font size change 
Shell also has better line wrapping. You still can't visually go
back to previous line, but atleas we now write from the beginning
of the line
 2023-03-22 02:09:22 +02:00
Bananymous b222581d18 Kernel: Reading from fd verifies that file is opened for reading 2023-03-22 01:55:58 +02:00
Bananymous a8e3ee6f19 Kernel: Ext2 directory functions now fail on invalid blocks 
Invalid blocks should only happen while writing to a file and
I think in that case we should just bail out instead of giving
you incomlete inode list or search result.
 2023-03-22 01:55:57 +02:00
Bananymous a083e588ba Kernel: cksum uses now a different crc32_table to match linux 'cksum' 2023-03-22 01:55:21 +02:00
Bananymous 9b500842a0 Kernel: Ext2 can now read from non-block-size aligned offsets 2023-03-21 19:19:17 +02:00
Bananymous b21348379f Kernel: Remove obsolete Ext2FS::ext2_root_inode() 
This was not used by anyone and the cast was wrong anyway
 2023-03-21 18:19:48 +02:00
Bananymous 633055293e Kernel: Remove for_each_block from Ext2 2023-03-21 18:14:02 +02:00
Bananymous ae9d618803 Kernel: Cleanup font parsing 
We use now the LittleEndian<> wrapper for PSF2 header and no more
magic constants in code
 2023-03-20 19:48:08 +02:00
Bananymous faf1b661bb Kernel: prefs font does not allocate extra buffer 2023-03-20 19:48:01 +02:00
Bananymous 22e45278a2 Kernel: Fix PC Screen font parsing 
I had misread the format and the parsing code was incorrect. I also
changed fonts to store unicode codepoints as 32 bit integers, so
every character can be represented
 2023-03-20 14:52:42 +02:00
Bananymous 43f4657566 Kernel: Font parsing uses Spans now 2023-03-20 13:35:54 +02:00
Bananymous 39b560fde3 Kernel: Add basic mounting to VFS. 2023-03-19 05:51:25 +02:00
Bananymous 76d5364a55 Kernel: Add comparison operator for inodes 2023-03-19 03:34:23 +02:00
Bananymous b41491e205 Kernel: Add cksum to Shell for file read testing 
I also removed the 'using namespace BAN'
 2023-03-18 03:50:24 +02:00
Bananymous 8236598f9d Kernel: Optimize Ext2 disk reads 
We used to read whole file until we reached the asked offset.
Now we can calculate the appropriate block and read just the asked data.
 2023-03-18 03:47:59 +02:00
Bananymous 1a26a318a4 Kernel: Rework filesystem reading 
We now read from a filesystem to user provided buffer.

Read sizes are determined by read call.

You should now get file descriptors and do reading through Process::current()
 2023-03-17 21:18:41 +02:00
Bananymous 1f2ceeb329 Kernel: VFS caches currently open inodes 2023-03-16 15:31:33 +02:00
Bananymous 1b7625581d Kernel: Add basic concept of Processes 
We now create Shell as a process that has its own threads
 2023-03-16 12:17:04 +02:00
Bananymous c012822d49 BAN: Rename StringView suffix from _sv to sv 2023-03-16 12:15:16 +02:00
Bananymous 8b8e3cbbf0 Kernel/Userspace: Start initial work on userspace and syscalls 2023-03-13 15:32:46 +02:00
Bananymous af854ec9e1 Kernel: Thread creation now takes void(*)() as entry and void* as data 
This simplifies threading for the future and gets rid of (undefined?)
cast of member function pointer to address
 2023-03-09 15:33:42 +02:00
Bananymous 8dbece9119 Kernel: kmalloc minimum align is forced to s_kmalloc_min_align 2023-03-09 14:37:25 +02:00
Bananymous 8940ff8002 Kernel: You don't have to check whether VFS is initialized or not 
VFS now returns Error when attempting to traverse inodes if it did
not find root partition
 2023-03-09 02:31:24 +02:00
Bananymous fc58baf54d Kernel: if VFS initialization does not find root, we fail 2023-03-09 02:17:42 +02:00
Bananymous 2e6e0d0ef5 Kernel: FIX ubsan complaining about unaligned addresses for STDHeaders 2023-03-08 22:55:44 +02:00
Bananymous 371dfe8ef3 BAN: Formatter now uses perfect forwarding on its arguments 2023-03-08 21:31:26 +02:00
Bananymous 7458f68c38 BAN: Error can now be constructed from c_string or format string 
If the resulting string would overflow, we just truncate it to fit
the error message buffer (128) bytes
 2023-03-08 17:05:37 +02:00
Bananymous d90aba0963 Kernel: Create CriticalScope and fix kmalloc 
This disables interrupts for the current scope and restores them
after the scope. This is used in kmalloc, since scheduler might
call into kmalloc/kfree, but deadlock if some thread is currently
trying to allocate. This allows us to use kmalloc in Scheduler.
 2023-03-08 13:55:53 +02:00
Bananymous a068d828fe Kernel: ATA reads go through the ata controller and not only device 2023-03-08 03:26:25 +02:00
Bananymous 1dabe7a222 Kernel: More rework on Scheduler 2023-03-08 03:26:25 +02:00
Bananymous e7a577f54a Kernel: fix includes 2023-03-08 03:26:25 +02:00
Bananymous 23b3028e15 Kernel: Rename RefCounted -> RefPtr and implement RefCounted 2023-03-08 03:26:25 +02:00
Bananymous f7ebda3bf1 Kernel: Move interrupt related functions to InterruptController 2023-03-08 03:16:51 +02:00
Bananymous b5673278c4 Kernel: Disable color after Debug::dump_stack_trace 2023-03-08 02:41:44 +02:00
Bananymous 0b62729887 Kernel: Scheduler sleeping is working 
We have to disable optimization for one function, but I'm working
on a fix
 2023-03-08 02:41:44 +02:00
Bananymous b8ee77eb78 Kernel: Initial work on new scheduler with queues 
Sleeping is definately broken
 2023-03-08 02:41:44 +02:00
Bananymous a9acf1f6dc Kernel: PCIDevice is now class with getters and constructor 2023-03-08 02:41:44 +02:00
Bananymous 42c33ebfb3 Kernel: kmalloc aligns size to s_kmalloc_min_align 
We don't get unaligned memory anymore from kmalloc
 2023-03-08 02:41:44 +02:00
Bananymous ed18d86f08 Kernel: Fix spinlock unlocking in x86_64 
Spinlock unlock used a 64 bit write on 32 bit integer, overwriting
some random memory. This caused some really hard to find bugs
 2023-03-08 02:41:44 +02:00
Bananymous df8811fc1a Kernel: Remove "a" from .section .text 2023-03-07 01:57:09 +02:00
Bananymous 8a52c0f9d7 Kernel: Cleanup RSDP parsing code 2023-03-07 00:41:13 +02:00
Bananymous 06db890d49 Kernel: Add ubsan 
My brain has been melting since I'm getting very random bugs.
I hope I can debug them better with ubsan :)
 2023-03-06 23:38:05 +02:00
Bananymous d5f302a68b Kernel: kmalloc now uses two locks 
One for fixed allocations and one for general allocations
 2023-03-06 12:40:35 +02:00
Bananymous f1f5e76636 Kernel: kmalloc requires alignment to be power of two 2023-03-02 22:31:13 +02:00
Bananymous 52aa98ba25 Kernel+LibC: Add some errno codes 
Kernel now returns ENOMEM and other errnos, so we dont have to write
error messages
 2023-03-02 21:10:44 +02:00
Bananymous 90a7268e5a BAN: Rewrite RefCounted to return ErrorOr 2023-03-02 12:30:11 +02:00
Bananymous 1dd61e93b6 Kernel: Threads cannot take arguments anymore 2023-03-02 01:56:09 +02:00
Bananymous 4d8bdec16d Kernel: fix i386 MMU 2023-03-02 00:47:29 +02:00
Bananymous 7fcbb869e1 Kernel: Initialize GDT in kernel code 
We dont use the boot GDT only while booting
 2023-03-01 21:21:56 +02:00
Bananymous 7f8cad83b1 Kernel: x86_64 boot script now makes GDT with null, kernel code and data 2023-03-01 21:21:56 +02:00
Bananymous ba8c4dbc7f Kernel: panic now disables interrupts as the first thing 2023-03-01 21:21:56 +02:00
Bananymous 9756de02ef Kernel: MMU now takes flags when allocating pages 2023-03-01 21:21:56 +02:00
Bananymous 7d84f290a1 Kernel: Add lock to Disk reads before I forget 2023-02-26 03:48:11 +02:00
Bananymous ee5d02aa70 Kernel: Rewrite basically all current disk io stuff 
This is a big commit that was kinda hard to split to smaller ones.

Essentially we now look at all the mass storage devices from PCI
and initialize (P)ATA devices. This doesn't provide any more functionality
but better abstractions and everything doesn't have to be on its old
default port that might be different for modern computers.
 2023-02-26 03:00:29 +02:00
Bananymous 40cf68a22a Kernel: Shell now sleeps through Scheduler and doesn't 'hlt' 
ls doesn't crash when trying to list file
 2023-02-26 02:57:27 +02:00
Bananymous 04bb08d27f Kernel: Add basic PCI enumeration 2023-02-26 02:56:53 +02:00
Bananymous 34f9912a1d Kernel: Add IO functions inl, outl, and ins{b,w,l} to read into buffer 2023-02-24 12:39:38 +02:00
Bananymous 80f9428337 Kernel: Fix prefs font for 32 bit 2023-02-24 03:19:54 +02:00
Bananymous 390a747768 Kernel: Add prefs font for terminal output before file system 2023-02-23 01:22:50 +02:00
Bananymous a4980acc88 Kernel: Fonts can now be parsed from the filesystem and set to terminal 
We currently dont have a fallback font if we cannot get to filesystem
initialization, but that will come later. I can't test on real hardware
for this reason.
 2023-02-22 22:29:31 +02:00
Bananymous 0e668738dc Kernel: Make some basic bitmap font parsing code 2023-02-22 22:28:12 +02:00
Bananymous a3e9e7d125 Kernel: Fix some shell commands 2023-02-22 21:55:32 +02:00
Bananymous 4cd99c71ca Kernel: kmalloc uses now spinlock and fix kmalloc_fixed() 2023-02-22 21:49:28 +02:00
Bananymous c9ea22f5e2 Kernel: IDT now confirms that it allocated succesfully 2023-02-22 21:48:40 +02:00
Bananymous d9c05b7378 Kernel: rewrite the whole kmalloc (again) 
Performance of the old kmalloc implementation was terrible.
We now use fixed-width linked list allocations for sizes <= 60 bytes.
This is much faster than variable size allocation.

We don't use bitmap scanning anymore since it was probably the slow
part. Instead we use headers that tell allocations size and aligment.

I removed the kmalloc_eternal, even though it was very fast, there is
not really any need for it, since the only place it was used in was IDT.

These changes allowed my psf (font) parsing to go from ~500 ms to ~20 ms.
(coming soon :D)
 2023-02-22 16:32:50 +02:00
Bananymous 5d31e89574 Kernel: Update ErrorOr API and add path find to VFS 
These two are done on the same commit since Changes to Shell were
annoying to make work with only one change
 2023-02-22 01:23:11 +02:00
Bananymous 038379274e Kernel: Inode can now return full mode value 
Kernel::Inode::Mode is an union of bitmasked fields for every
possible bit
 2023-02-20 21:39:24 +02:00
Bananymous efaca469ee Kernel: Ext2Inode now supports indirect blocks through for_each_block() 2023-02-20 10:25:15 +02:00
Bananymous 80006ea137 Kernel: Initial work on filesystem 
We support now ext2 directory listing. File reading is not yet supported.
 2023-02-20 01:46:00 +02:00
Bananymous 247f03c79e BAN: Make ErrorOr<> have attribute [[nodiscard]] 
We don't have to specify it everytime we make function return ErrorOr
 2023-02-19 20:10:30 +02:00
Bananymous feaeee11e5 Kernel: fix ARCH() macro and add helper macros for push/pop 2023-02-19 18:52:25 +02:00
Bananymous 0506fee34a Kernel: Shell's thread now uses sleep instead of polling 
Also added 'sleep' command that just sleeps for 5 seconds
 2023-02-19 18:52:25 +02:00
Bananymous 1bd8b0fe5c Kernel: Sleep now actually sleeps and allows idling 2023-02-19 18:52:25 +02:00
Bananymous 8f1b6da2af Kernel: Use Vector instead of raw poiters in Disk stuff 
We now don't have to manually free allocated data
 2023-02-16 20:48:41 +02:00
Bananymous 460fc3a29f Kernel: Start working on filesystem 
We have a basic PATA driver (for reading) and gpt parser.
 2023-02-16 20:00:31 +02:00
Bananymous 94cbacc998 Kernel: PIT now has very barebones sleep 2023-02-16 17:53:25 +02:00
Bananymous 1b45b4d728 Kernel: Remove unnecessary BOCKS_BREAK() 2023-02-16 17:52:39 +02:00
Bananymous 6a133782ed All: Move to c++20 2023-02-09 23:05:26 +02:00
Bananymous fb7fe73d49 Kernel: Add inw and outw to IO 2023-02-04 23:37:34 +02:00
Bananymous 6fab26692b Kernel: remove unnecessary function from x86_64 Thread.S 2023-02-02 23:48:18 +02:00
Bananymous 2161528cb6 Kernel: Shell is now launched as a capturing lambda 2023-02-02 23:27:51 +02:00
Bananymous cdbad56ed7 Kernel: Update shell thread command to run following command as thread 
'thread echo "Hello World"' runs the command 'echo "Hello World"' after
5 seconds have passed. This was just my test code for threading
 2023-02-02 23:26:19 +02:00
Bananymous 5b5e620d8a Kernel: Improve multithreading support 
We can now use arbitary BAN::function<void(...)> as the Thread.
I also implemented multithreading for i386 since it was not done
on the initial multithreading commit.
 2023-02-02 23:24:12 +02:00
Bananymous 777ede328e Kernel: Add helper functions for reading current rsp and rbp 2023-02-02 23:19:44 +02:00
Bananymous c85b97abee Kernel: fix some of i368 IDT. This was really broken 2023-02-02 15:52:06 +02:00
Bananymous 117d1de038 Kernel: panic does not need to include <kernel/kprint.h> 
This allows us to not have kprint available literally everywhere
 2023-02-02 15:51:15 +02:00
Bananymous 6cbad718fb Kernel: Add some more cxxabi functionality 
We can now declate static variables in functions
 2023-02-02 15:50:26 +02:00
Bananymous f6b05212e0 Kernel: Add is_locked() to spinlock 
I think this is atomic read
 2023-02-02 15:49:30 +02:00
Bananymous 01f267a321 Kernel: fix spinlock for i386 2023-02-02 15:49:00 +02:00
Bananymous 9b8de5025a All: rename every function from UpperCamelCase to snake_case 
This was a mess since I didn't know which to use but now I decided
to go with snake_case :)
 2023-02-01 21:05:44 +02:00
Bananymous 6a9d60a8fb Kernel: Implement somewhat functioning multithread support 
This still uses only a single cpu, but we can now have 'parallelization'

This seems to work fine in qemu and bochs, but my own computer did not
like this when I last tried.

I have absolutely no idea how multithreading should actually be
implmemented and I just thought and implemented the most simple one I
could think of. This might not be in any way correct :D
 2023-02-01 01:53:35 +02:00
Bananymous 7d8aafa0b5 Kernel: Add macros for current archutecture 2023-02-01 01:52:52 +02:00
Bananymous 337569b0ca Kernel: Implement basic SpinLock 2023-02-01 01:52:52 +02:00
Bananymous be502ae616 Kernel: Debug stacktrace now detects if it kernel panics itself 2023-01-31 18:43:09 +02:00
Bananymous cb3b62d665 Kernel: Only allocate single GDT entry during boot.S 
When we need more, we should probably initialize rest of them
in cpp code
 2023-01-31 18:43:09 +02:00
Bananymous 1954f223ad Kernel: Add no sse and sse2 for kernel code 2023-01-31 18:43:09 +02:00
Bananymous 1687028ed5 Kernel: Add constructor and destructor to MMU 2023-01-30 18:54:04 +02:00
Bananymous 6dc22b7251 Kernel: Add actual register values to x86_64 kernel panic 
Very hackish implementation, but we now get actual registers at the
time of the interrupt happening
 2023-01-30 18:52:38 +02:00
Bananymous bfe3426f6d Kernel: Add processor dump flag to APIC 2023-01-26 13:13:46 +02:00
Bananymous 6418d7cfc3 Kernel: Add Other GDT entries to x86_64 2023-01-26 12:53:04 +02:00
Bananymous f0093ed2fd Kernel: kmalloc_eternal now updates the used/free values 
I also improved the kmalloc_dump_info() formatting. We format the
values as 8-digit hex numbers since (atleast for now) the kmalloc
will always be under 4 GiB address and size :)
 2023-01-26 03:04:19 +02:00
Bananymous e00d18029d Kernel: rewrite some of APIC since it didn't work with xsdts for some reason 2023-01-26 02:57:14 +02:00
Bananymous 35d2e27292 Kernel: Improve MMU 
We don't have to invalidate page in AllocatePage() if we don't make
any changes. We also should not assert on deallocating non-present
pages, just return early :)
 2023-01-26 02:57:14 +02:00
Bananymous 589f338357 Kernel: Cleanup IDT register dump inline assembly 2023-01-26 02:57:14 +02:00
Bananymous 05b48fa71c Kernel: add gcc option to make sure we have (r/e)bp saved on stack 2023-01-26 02:57:14 +02:00
Bananymous aa0757e135 Kernel: Move dump_stacktrace from panic -> debug 2023-01-26 02:57:14 +02:00
Bananymous e87026f01d Kernel: I have no idea what this commit does 
I had committed a change in IDT but reverted it now.

This propably only adds a spurious interrupt detection to common cpp
interrupt handler?
 2023-01-26 02:55:37 +02:00
Bananymous 9c31790359 Kernel: Add option to disable Serial output 
This makes all debug output to appear on the TTY
 2023-01-25 22:51:42 +02:00
Bananymous c0bc002ac6 Kernel: Move debug printing to its own file 
It didn't make sense that dprint was defined in Serial.h.
We also now dump dprint to tty if there is no serial and tty is initialized
 2023-01-25 22:51:42 +02:00
Bananymous b315fdc27f Kernel: Finally managed to get 64-bit working 
I had weird problems with interrupts but everything should work now
 2023-01-25 19:19:28 +02:00
Bananymous c4670f49d4 Kernel: Refactor some IDT code 2023-01-25 19:19:28 +02:00
Bananymous 48348c9e57 Kernel: Cleanup APIC code. Remove unnecessary defines and add consts 2023-01-25 19:00:41 +02:00
Bananymous ba53582f23 Kernel: Rewrite APIC and PIC more OOP friendly 
x86_64 port is slowly coming together
 2023-01-23 20:13:57 +02:00
Bananymous b50bb03ed4 Kernel: Panic now halts machine even if we get spurious irqs 2023-01-23 18:25:48 +02:00
Bananymous 54043288cb Kernel: Move CPUID out of arch/ 
CPUID instructions behaves the same on x86 and x86_64. I am not
planning on supporting any non x86 based architectures.
 2023-01-23 18:12:52 +02:00
Bananymous 1b9f7aa815 Kernel: Rewrite the whole VESA driver 
We dont support vga text mode currently. I might add it later if needed.

I also removed mouse 'support' from Shell since it didn't do anything
and I didn't implement arbitary bitmap rendering to framebuffer
 2023-01-23 13:21:53 +02:00
Bananymous 10c7ef7baa Kernel: MMU rename weird variable 2023-01-22 20:16:44 +02:00
Bananymous b67bbab083 Kernel: fix dump_stacktrace 2023-01-22 20:05:24 +02:00
Bananymous 62469c529f Kernel: IDT now allocates descriptors with kmalloc_eternal 2023-01-22 03:18:42 +02:00
Bananymous 026fdc251c Kernel: Add kmalloc_eternal back 2023-01-22 03:10:48 +02:00
Bananymous cdd27ae3db Kernel: rename MMU::m_page_directory_pointer_table -> m_highest_paging_stuct 
This might not always be pdpt. In x86_64 it is pml4/pml5
 2023-01-22 03:03:58 +02:00
Bananymous 6ec4ba3dc9 Kernel: Move dump_backtrace() out of arch. 
I discovered __builtin_frame_address()
 2023-01-22 03:00:13 +02:00
Bananymous fbfb3d6b70 Kernel: IDT cleanup GateDesctiptor usage 
And move everything to IDT namespace
 2023-01-22 02:06:43 +02:00
Bananymous 558374a47c Kernel: IDT flush only once in initialization 2023-01-22 02:06:43 +02:00
Bananymous 6e24ef8323 Kernel: IDT cleanup Kernel panic messages 2023-01-22 02:06:43 +02:00
Bananymous 3e8fbbaabd Kernel: Fix small typos in IDT 2023-01-22 01:12:47 +02:00
Bananymous 491610db2c Kernel: move GDT initialization to boot.S 2023-01-22 00:48:12 +02:00
Bananymous aac7595a47 Kernel: cleanup boot.S code and enable SSE 2023-01-21 23:44:23 +02:00
Bananymous fdbc04f29d Kernel: kmalloc now uses the actual kernel end location 2023-01-21 22:40:23 +02:00
Bananymous 9088f7b305 Kernel: kmalloc prints addresses on panic 2023-01-21 22:29:44 +02:00
Bananymous b5453fad5c Kernel: dump_stacktrace uses now "\r\n" line endings for bochs 2023-01-21 22:21:38 +02:00
Bananymous bb051604a1 Kernel: Move dump_stacktrace() to arch folder 
It uses mov instruction which has different register on x86/x86-64
 2023-01-21 22:16:31 +02:00
Bananymous 9e092c80c0 Kernel: Cleanup boot.S 2023-01-21 22:16:01 +02:00
Bananymous 53a5ad3cf9 BAN: Function now properly forward arguments 2023-01-17 11:16:46 +02:00
Bananymous b9a4530e54 Kernel: Kernel::Panic now dumps stacktrace to com1 2023-01-16 21:50:50 +02:00
Bananymous 7540fa0385 Kernel: Shell now 'properly' parses commandline 2023-01-16 20:09:22 +02:00
Bananymous e307db47eb Kernel: Kernel::Panic() will now always print to serial output 2023-01-16 15:44:27 +02:00
Bananymous 73abc3b2ee fixup! Kernel: Move GDT to its own namespace and cleanup 2023-01-16 15:24:59 +02:00
Bananymous 46e5b3f3d6 Kernel: Move GDT to its own namespace and cleanup 2023-01-16 15:24:10 +02:00
Bananymous b46fa0d116 Kernel: Shell can now dump kmalloc info 2023-01-16 15:17:00 +02:00
Bananymous 8881c1e117 Kernel: Shell is no longer singleton 2023-01-16 15:16:39 +02:00
Bananymous 1545850be3 Kernel: Input callbacks use the new BAN::Function 2023-01-16 15:15:02 +02:00