82a1a29260
Kernel: More proper paging in Elf loading
2023-04-22 18:17:44 +03:00
8a5608df91
Kernel: d{print,warn,error}ln(...) now has a spinlock
2023-04-22 17:58:51 +03:00
3f1c0ec91b
Kernel: Process now frees up its pages on destruction
2023-04-22 16:54:46 +03:00
1406a75a92
Kernel: Cleanup process creation for userspace
2023-04-22 16:51:50 +03:00
8001493df3
Kernel: Fix some deadlocks in the Process
2023-04-22 16:19:57 +03:00
8c1f5bfe1e
Kernel: Remove obsolete userspace stuff from kernel
2023-04-22 15:38:45 +03:00
ec8b9640e2
Kernel: Usespace programs are now ran through ELF files
...
only 64 bit elf files are supported for now.
2023-04-22 15:35:32 +03:00
d9068eebb5
Kernel: kmalloc does not dump stack trace
...
dump_stack_trace() page faults and i dont feel like debugging this
now :)
2023-04-21 13:45:13 +03:00
3ad0d2328d
Kernel: Don't call 'cli' on interrupt
...
This is automatically done because we are using interrupt gates
in the IDT
2023-04-21 11:18:08 +03:00
3f2beb4547
Kernel: Fix syscall return value in 32 bit
2023-04-21 11:08:02 +03:00
be14a6c239
Kernel: Stack pointer is validated when updated
...
This allows us not to fail stack pointer when in syscall since
interrupts use their own stack
2023-04-21 10:40:24 +03:00
3aa0eeb4a3
Kernel: Add barebones per process virtual addresses
...
We now assign every (userspace) process its own MMU which we load
in scheduler. This allows every process to have separate virtual
address space.
This is very hackish implementations but it works for now
2023-04-20 00:45:41 +03:00
b3eeb6412f
Kernel: Add some bareboness functionality to map virtual addresses
2023-04-19 23:51:36 +03:00
d38470c8e2
Kernel: Rename MMU::{un,}allocate... to MMU::{un,}map
...
This is more appropriate name for the behaviour :D
2023-04-19 21:50:30 +03:00
a159c980ee
Kernel: kmalloc will always print debug on failed alloc
2023-04-19 18:05:01 +03:00
4475e3e184
Kernel: ATAController will fail to initialize in native mode
2023-04-19 17:29:36 +03:00
cf0320e47d
Kernel: PCI devices now report their prog_if
2023-04-19 16:43:05 +03:00
cd03a95128
Kernel: Shell fix file reading
...
We were reading 8 bytes at a time instead of the 1024 we were
supposed to :DD
2023-04-19 14:09:23 +03:00
51e299c7e3
Kernel: Shell now has exit() command
2023-04-19 12:53:09 +03:00
6f65453fd4
Kernel: Fix Process::exit() and where it is called from
...
cksum doesn't seem to work anymore on big files. I have to look
into this. It locks up after couple of seconds...
2023-04-19 12:52:21 +03:00
d74ce4950c
Kernel: We now launch Shell again on boot
...
Adding this just before push :D
2023-04-19 00:41:24 +03:00
59a682c720
Kernel: init2 is now launched as a process instead of thread
...
Also only process can now add threads to scheduler. Nobody should
have raw access to scheduler and everything should be through
Process::current() or irqs (reschedules)
2023-04-19 00:39:06 +03:00
7bd4593748
Kernel: Process is not reference counted any more
...
This was not necessary and it made things needlessly complicated
2023-04-19 00:34:18 +03:00
5494e2c125
Kernel: Heap allows us to take free pages.
...
The API is kinda weird and will probably be reworked in near future
but this will work for now :)
2023-04-18 10:18:15 +03:00
aba82564f5
Kernel: Panic wont print stacktrace if it has already paniced
...
This prevents stack trace dump to panic and loop
2023-04-18 10:18:15 +03:00
93abee9c7c
Kernel: Map all ACPI tables on initialization
...
This makes their usage much easier and less error prone
They won't mapped be processes when we get to there, so this won't be
a problem
2023-04-18 10:18:15 +03:00
821d065eba
Kernel: Handle some Heap edge cases
2023-04-18 10:18:15 +03:00
2614437ba0
Kernel: Reorder boot initialization
...
We now create the TTY as soon as possible so we can show console
output without serial port.
2023-04-18 10:18:15 +03:00
1aac3a0425
Kernel: Heap implementation can now give free pages from all of RAM
2023-04-18 10:18:15 +03:00
a4568f9263
Kernel: Remove unused file
2023-04-18 10:18:15 +03:00
a180e72b6f
Kernel: Start working on heap
2023-04-18 10:18:15 +03:00
2de64b592d
Kernel: Kmalloc now has its memory statically allocated
...
We don't use the memory map given by bootloader since this automatically
maps the memory to a available space.
2023-04-18 10:18:15 +03:00
9c0f3dd996
Kernel: Move kmalloc and MMU to Memory directory
2023-04-18 10:18:15 +03:00
079df39ca8
LibELF: Start implementing elf library
2023-04-18 10:18:15 +03:00
fe87c08a02
LibC: add needed stubs to build executables with our compiler
2023-04-12 17:53:02 +03:00
8637959289
Kernel: We can create basic userspace processes
...
These are still allocated on the kernel memory
2023-04-12 17:52:36 +03:00
6be53668b9
Kernel: Scheduler can now terminate processes threads
2023-04-12 17:49:04 +03:00
d1b7249803
Kernel: Debug::dump_stack_trace now 'detects' repeating function
2023-04-12 01:32:41 +03:00
ff7c50c627
Kernel: kmalloc does not check for corruptiong unless it cannot allocate
...
We 'don't care' if kmalloc is corrupted unless it prevents us from
allocating memory. Scheduler should be catching stack overflows either
way and is much more efficient
2023-04-12 00:24:02 +03:00
12779cdef8
Kernel: Threads now use only 4 KiB stack :)
2023-04-12 00:22:08 +03:00
f5e676b2b7
Kernel: Fix TTY spinlock usage
2023-04-12 00:20:04 +03:00
8e5e5f819f
Kernel: Shell TTY_PRINT is now function instead of macro
...
This makes functions uses way less stack
2023-04-12 00:18:58 +03:00
370a958379
BuildSystem: GCC will now complain on functions with 1 KiB stack
2023-04-12 00:18:06 +03:00
a0bd3dc54f
Kernel: kmalloc now detects corruption
...
Kmalloc checks if its nodes have corrupted. This was happening
because of stack overflow.
2023-04-11 23:36:46 +03:00
809eb2fe3e
Kernel: Mark Scheduler::start() as noreturn as appropriate
2023-04-11 23:33:20 +03:00
7010d8614f
Kernel: kernel doesn't allocate large blocks of data on stack
...
We used to allocate 1 KiB blocks on multiple places on stack. This
is a problem, since kernel stack shouldn't have to be too big
2023-04-11 23:31:58 +03:00
69f13f1896
Kernel: Scheduler will panic if it encounters stack overflow
2023-04-11 23:29:21 +03:00
bdaf7cddcb
Kernel: Process now locks the mutex while modifying open files
...
This allows processes to be actually removed from the list instead
of dead locking
2023-04-11 23:28:16 +03:00
8d6db168d6
Kernel: remove message from BAN::Error
...
We don't store the error message anymore in BAN::Error.
Instead we store a error code that can be mapped into a string.
This allows BAN::Error to only take 4 bytes instead of 128.
We should also make some kernel initialization just panic instead
of returning errors since they are required for succesfull boot
anyway.
2023-04-11 23:25:21 +03:00
2fabe1949c
BAN: Move RefPtr to its own file and create New.h
...
New.h contains definitions for placement new operators and
BAN::allocator and BAN::dealloctor
2023-04-10 21:07:25 +03:00
c660df14ec
BuildSystem: Fix header copying to sysroot
...
We used to copy all headers everytime to sysroot which caused
rebuild of the whole os. Now we use the cmake command
'copy_directory_if_different' which seemed to fix this issue :)
2023-04-10 21:07:25 +03:00
e704968f96
Kernel: Threads can now be terminated mid execution
2023-04-10 21:07:25 +03:00
32359df939
Kernel: Add small wait in ATA driver before reading/writing
...
This allows bochs to boot again
2023-04-10 21:07:25 +03:00
641ed23380
Kernel: Fix framepointers on started threads
2023-04-10 21:07:25 +03:00
9f977488fa
BuildSystem: cmake can now build out libc
...
I can't seem to get libc++ build to work...
2023-04-10 21:07:25 +03:00
7752b02fb7
BuildSystem: remove now obsolete include directories from kernel build
2023-04-07 02:25:47 +03:00
f70cd3ea77
BuildSystem: Cleanup cmake code
...
The buildsystem is kind of a mess. I will be writingn build
instructions soon.
2023-04-06 20:31:10 +03:00
5db5ff069a
BuildSystem: you can now build the toolchain with cmake
2023-04-06 00:23:02 +03:00
e84f613c4d
Kernel: Shell now somewhat functions again
...
I will not be fixing the shell implementation until I get to
userspace
2023-04-05 11:37:41 +03:00
5db4e5b4d5
Kernel: Fix TTY echo and canonical flag behaviour
2023-04-05 11:35:19 +03:00
b00dd8d68d
Kernel: Fix ansi control sequence cursor movement
2023-04-05 03:07:52 +03:00
abbbf7ec15
Kernel: Add tty to process and make termios modifiable
2023-04-05 02:53:28 +03:00
d0b1457f30
Kernel: TTY now supports clearing
2023-04-05 02:04:18 +03:00
a423cd8bb3
Kernel: Add partial support for shell
...
We don't handle arrow keys, and the tty does not know how to clear
the screeen :D
2023-04-05 01:30:58 +03:00
db076058b9
Kernel: Process can now initialize stdio
...
This allows the use of the fds STD{IN,OUT,ERR}_FILENO
2023-04-05 01:10:25 +03:00
a1100624bf
Kernel: Start work on making tty a file
...
TTY is now a file that you can read from/write to. I still have
to port shell to use this new interface
2023-04-05 00:56:09 +03:00
28e1497f88
Kernel: add virtual write function to inode
2023-04-03 20:29:07 +03:00
8d6111641e
Kernel: Fix keys in PS2Keymap
2023-04-03 20:25:23 +03:00
3ee20d1a84
Kernel: Fix typo
2023-04-03 19:56:55 +03:00
002c2d0aca
BuildSystem: remove non-existent file from kernel CMakeLists.txt
2023-04-03 19:02:25 +03:00
461a5774f8
Kernel: Device dev and rdev number is done more properly
...
Also hd* partitions are now 1 indexed instead of 0
2023-04-03 11:43:16 +03:00
ebfd092075
Kernel: Cleaner partition parsing errors
2023-04-03 09:55:49 +03:00
e322826347
Kernel: Optimize scheduler idling
...
Now after each interrupt we will ask the scheduler to reschedule
if the current thread is the idle thread. This allows semaphore
unblocking to be practically instant when there is only one thread
executing.
Now disk reading is back to ~3 MB/s for single threaded process
2023-04-03 01:51:05 +03:00
3998c5f955
Kernel: ATA now uses irqs instead of polling
...
Reading is now much slower at ~500 kB/s it was around 3 MB/s.
This is probably mostly due semaphore blocking taking atleast
until next reschedule (1 ms itervals). This will be a problem
as long as we are using only single processor.
I could try to use {READ/WRITE}_MULTIPLE commands, but since
most of the disk reads are 2 sectors (inode block size) this
will at most double the speed.
Most efficient speed up would of course be caching disk access
data and inodes overall.
2023-04-03 00:03:38 +03:00
762d22ed28
Kernel: Move ATADevice to its own file from ATAController
...
The API is kinda weird since device reads/writes go from
ATADevice -> ATAController -> ATADevice
but this is for now atleast necessary since ATAController has(?)
to keep all devices from using the disks at the same time
2023-04-02 18:26:19 +03:00
f2362b2b78
Kernel: ATA controller waits now before read/write until disk is ready
...
Qemu used to freeze on disk writes but now it seems fine
2023-04-02 05:37:17 +03:00
471ac80420
BuildSystem: building for 32-bit works now
2023-04-02 05:03:17 +03:00
e49d3c7bfe
BuildSystem: We are now using cmake instead of plain make
...
I have been annoyed for a while since I had to build everything
when running the os since the buildsystem was really bad.
I wanted to rewrite the whole build system and changed to using cmake
:)
2023-04-02 04:07:27 +03:00
79090c2648
Kernel: cleanup includes
...
I went quickly went through all files since I found some weird
includes :D
2023-04-01 02:14:49 +03:00
7a6b1c8e47
Kernel: Fix traversing back from mount points
2023-04-01 01:54:35 +03:00
8988ce2766
Kernel: Add inodes '.' and '..' to device manager
2023-04-01 01:33:04 +03:00
dcde2ae6b4
Kernel: Reads return 0 bytes read at the end of device
...
We used to not have any idea if we where already at the end of device.
Also fixed couple of copy-paste errors from read->write
2023-04-01 00:55:07 +03:00
c62849a783
Kernel: Shell cleanup cat command
2023-04-01 00:54:39 +03:00
f453e8e170
Kernel: Shell 'time' prints the time even if command fails
2023-04-01 00:30:33 +03:00
990887891e
Kernel: Process gets absolute paths for mount
2023-04-01 00:30:11 +03:00
5da801d12b
Kernel: fix ext2 failed creation memory leak
2023-04-01 00:22:03 +03:00
3a4557d417
Kernel: Cleanup ATA device initialization
2023-03-31 00:58:57 +03:00
26d9a3e253
Kernel: Move DeviceManager to its own file
2023-03-30 22:39:45 +03:00
eef3631a5a
Kernel: Improve locking in Process, VFS and ATAController
...
We used to block on all process access. This meant that shell
reading the keyboard input would block all VFS access making disk
accesses practically impossible. We now block only when it is
necessary :)
2023-03-30 22:02:16 +03:00
88ee35165f
Kernel: Thread is no longer RefCounted
...
This makes developement with Scheduler much easier against compiler
optimizations. I could now remove the pragma GCC optimize stuff.
2023-03-30 19:16:51 +03:00
c8f05b4a7a
Kernel: Add Semaphore to block threads
2023-03-30 18:46:33 +03:00
2995a36942
Kernel: root partition is now passed from the commandline
2023-03-30 18:46:19 +03:00
3e8ab8271d
Kernel: Shell can now mount partitions
2023-03-30 15:06:41 +03:00
5b3a00c64f
Kernel: Inode::Mode is now a struct so we can have functions in it
2023-03-30 14:41:15 +03:00
0ce9fd8597
Kernel: StorageDevices and Controllers are now devices
2023-03-30 14:22:15 +03:00
c9badb5a1c
Kernel: Add IFBLK, IFLNK, IFSOCK to Inode::Mode
2023-03-30 13:15:46 +03:00
a513bc5749
Kernel: All devices have atime, mtime, ctime at their creation
2023-03-30 13:15:46 +03:00
5d5487315f
Kernel: Remove the mount test from VFS
2023-03-30 11:43:24 +03:00
3508df67b1
Kernel: fix stat command and device numbers
2023-03-30 10:43:08 +03:00
06ce1f0667
Kernel: Rewrite mounting code
2023-03-29 21:34:48 +03:00
1fb8c211f0
Kernel: Move Partition out of StorageDevice and rename functions
2023-03-29 13:23:01 +03:00
9c7670847e
Kernel: Shell commands 'ls' and 'stat' recognize character devices
2023-03-29 11:56:33 +03:00
a24c2d9be2
Kernel: DeviceManager is now a 'FileSystem' so it can expose devices
...
Shell reads keyboard through /dev/input :)
2023-03-29 11:50:46 +03:00
7f90079ea7
Kernel: Fix keymap numlock behaviour
2023-03-29 03:18:22 +03:00
f4b4987d43
Kernel: Remove obsolete KeyboardLayout/
...
This was used by the old input system. Currently keyboard layout is
hardcoded to finnish. But it will be reworked as something read from
the filesystem
2023-03-29 03:09:14 +03:00
ac094a48d6
Kernel: Rework the whole input system
...
We now use Device abstraction that will allow us to provide devices
to userspace through /dev. Currently Shell reads from first and only
device (it being PS/2 Keyboard).
2023-03-29 03:05:16 +03:00
f9a0412e78
Kernel: ACPI unmap_header does not do anything
...
We have to work with MMU mapping/unmapping to be user friendly
2023-03-28 02:56:44 +03:00
2f8c9746e3
Kernel: Move ACPI to its own file
2023-03-27 17:30:45 +03:00
f8a2c60c8d
Kernel/BAN: move unix time conversion to BAN and add stat to Shell
2023-03-27 00:49:58 +03:00
770f7716a0
Kernel: Rework processes and VFS so we don't expose inodes
...
Everything is now done through a file descriptor.
2023-03-26 04:30:57 +03:00
d67de70126
Kernel: Process::working_directory() is now thread safe
...
I realized you cannot return a stirng view and it to be thread safe
2023-03-24 01:46:25 +02:00
6f334756c5
Kernel: Create RecursiveSpinLock and add it to Process
...
We now lock every function within Proccess, just to be sure.
Recursive lock allows us to use lock from the same thread even if
we already have the spinlock locked
2023-03-24 01:32:35 +02:00
310713d203
Kernel: Lock process functions instead of the ata controller
...
Process has to use locks at least on some functions so multithreaded
disk io is safe. This seemed to fix corrupted reads from disk
2023-03-24 01:17:39 +02:00
7d2ab53baa
Kernel: Ext2FS now does allocations better
...
We only have to allocate at the beginning of the all functions and
can properly exit before any disk reads if we run out of memory.
This makes development little bit 'harder' since the {read,write}_block
user must allocate a buffer of atleast block_size bytes.
I also made disk access to cause kernel panic on error since the error
handling during file write is something I don't want to think now.
The filesystem can easily corrupt so, I feel like when disk io starts
to fail I'll come back to this.
2023-03-23 23:22:31 +02:00
2152b8b95f
Kernel: Add possibiliity to create empty files on Ext2
...
Big rewrite for Ext2 for more easy and optimized code
2023-03-23 22:26:06 +02:00
4fd21bc303
Kernel: Remove block group descriptor cache from ext2fs
...
This will make improving the fs easier since we need to only update
the values on the disk
2023-03-23 18:52:58 +02:00
15037bfc7a
Kernel: Move get_unix_time to RTC namespace
2023-03-23 18:14:51 +02:00
3572e9794a
BAN: Modify Span constructors to keep constness correctly
2023-03-23 14:26:03 +02:00
6ed9651176
Kernel: StorageDevice and Ext2 "support" writing
2023-03-23 13:04:13 +02:00
3efbe22a1b
Kernel: Shell now prints unix time with 'date' command
2023-03-23 11:13:51 +02:00
96579b88cf
Kernel: Cleanup GPT parsing code
2023-03-23 11:13:14 +02:00
2ec18855f2
Kernel: TTY buffer is resized on font size change
...
Shell also has better line wrapping. You still can't visually go
back to previous line, but atleas we now write from the beginning
of the line
2023-03-22 02:09:22 +02:00
b222581d18
Kernel: Reading from fd verifies that file is opened for reading
2023-03-22 01:55:58 +02:00
a8e3ee6f19
Kernel: Ext2 directory functions now fail on invalid blocks
...
Invalid blocks should only happen while writing to a file and
I think in that case we should just bail out instead of giving
you incomlete inode list or search result.
2023-03-22 01:55:57 +02:00
a083e588ba
Kernel: cksum uses now a different crc32_table to match linux 'cksum'
2023-03-22 01:55:21 +02:00
9b500842a0
Kernel: Ext2 can now read from non-block-size aligned offsets
2023-03-21 19:19:17 +02:00
b21348379f
Kernel: Remove obsolete Ext2FS::ext2_root_inode()
...
This was not used by anyone and the cast was wrong anyway
2023-03-21 18:19:48 +02:00
633055293e
Kernel: Remove for_each_block from Ext2
2023-03-21 18:14:02 +02:00
ae9d618803
Kernel: Cleanup font parsing
...
We use now the LittleEndian<> wrapper for PSF2 header and no more
magic constants in code
2023-03-20 19:48:08 +02:00
faf1b661bb
Kernel: prefs font does not allocate extra buffer
2023-03-20 19:48:01 +02:00
22e45278a2
Kernel: Fix PC Screen font parsing
...
I had misread the format and the parsing code was incorrect. I also
changed fonts to store unicode codepoints as 32 bit integers, so
every character can be represented
2023-03-20 14:52:42 +02:00
43f4657566
Kernel: Font parsing uses Spans now
2023-03-20 13:35:54 +02:00
39b560fde3
Kernel: Add basic mounting to VFS.
2023-03-19 05:51:25 +02:00
76d5364a55
Kernel: Add comparison operator for inodes
2023-03-19 03:34:23 +02:00
b41491e205
Kernel: Add cksum to Shell for file read testing
...
I also removed the 'using namespace BAN'
2023-03-18 03:50:24 +02:00
8236598f9d
Kernel: Optimize Ext2 disk reads
...
We used to read whole file until we reached the asked offset.
Now we can calculate the appropriate block and read just the asked data.
2023-03-18 03:47:59 +02:00
1a26a318a4
Kernel: Rework filesystem reading
...
We now read from a filesystem to user provided buffer.
Read sizes are determined by read call.
You should now get file descriptors and do reading through Process::current()
2023-03-17 21:18:41 +02:00
1f2ceeb329
Kernel: VFS caches currently open inodes
2023-03-16 15:31:33 +02:00
1b7625581d
Kernel: Add basic concept of Processes
...
We now create Shell as a process that has its own threads
2023-03-16 12:17:04 +02:00
c012822d49
BAN: Rename StringView suffix from _sv to sv
2023-03-16 12:15:16 +02:00
8b8e3cbbf0
Kernel/Userspace: Start initial work on userspace and syscalls
2023-03-13 15:32:46 +02:00
af854ec9e1
Kernel: Thread creation now takes void(*)() as entry and void* as data
...
This simplifies threading for the future and gets rid of (undefined?)
cast of member function pointer to address
2023-03-09 15:33:42 +02:00
8dbece9119
Kernel: kmalloc minimum align is forced to s_kmalloc_min_align
2023-03-09 14:37:25 +02:00
8940ff8002
Kernel: You don't have to check whether VFS is initialized or not
...
VFS now returns Error when attempting to traverse inodes if it did
not find root partition
2023-03-09 02:31:24 +02:00
fc58baf54d
Kernel: if VFS initialization does not find root, we fail
2023-03-09 02:17:42 +02:00
2e6e0d0ef5
Kernel: FIX ubsan complaining about unaligned addresses for STDHeaders
2023-03-08 22:55:44 +02:00
371dfe8ef3
BAN: Formatter now uses perfect forwarding on its arguments
2023-03-08 21:31:26 +02:00
7458f68c38
BAN: Error can now be constructed from c_string or format string
...
If the resulting string would overflow, we just truncate it to fit
the error message buffer (128) bytes
2023-03-08 17:05:37 +02:00
d90aba0963
Kernel: Create CriticalScope and fix kmalloc
...
This disables interrupts for the current scope and restores them
after the scope. This is used in kmalloc, since scheduler might
call into kmalloc/kfree, but deadlock if some thread is currently
trying to allocate. This allows us to use kmalloc in Scheduler.
2023-03-08 13:55:53 +02:00
a068d828fe
Kernel: ATA reads go through the ata controller and not only device
2023-03-08 03:26:25 +02:00
Bananymous