6acb86c14b
Kernel: MMU keeps track of the current
2023-05-16 00:26:39 +03:00
ec316391c5
Kernel: argc is passed as zero to userspace
2023-05-11 18:28:32 +03:00
177b205c48
BuildSystem: userspace has cmake target
2023-05-11 16:19:53 +03:00
729ff267d7
LibC: add function declarations to sys/stat.h
2023-05-11 15:11:33 +03:00
ff2e2937a5
Kernel: Remove offset from OpenFileDescriptor
...
This is now handled on the libc side. There might be reasons to
have it in kernel side, but for simplicity's sake I'm moving it
to libc for now :)
2023-05-09 20:31:22 +03:00
512be884ed
Kernel: Add barebones GeneralAllocator for >4096B
2023-05-08 22:10:49 +03:00
f1667b398a
Kernel: FixedWidthAllocator operates on MMU
...
Instead of Process* we use MMU& in FixedWidthAllocator since it is
everything it actually needs :)
2023-05-08 00:06:56 +03:00
b0ec0f1a1a
Kernel: We add FixedWidthAllocators on demand
...
On SYS_ALLOC we will add a new FixedWidthAllocator if the old ones
are already full or we don't have one with proper size. This allows
arbitary number of allocations as long as you have enough memory
available :)
Next I will be writing a general allocator for allocations larger
than 4096 bytes which should make SYS_ALLOC syscall complete :)
2023-05-07 23:57:01 +03:00
12e42f40c5
Kernel/LibC: add free function for FixedWidthAllocator
...
I have to rework the syscall API and allocators in process. For
now this works well enough :)
2023-05-07 01:21:50 +03:00
890aa9aa15
BuildSystem: linker -O2 doesn't do anything? hopefully
2023-05-06 19:58:08 +03:00
bcfd838131
Kernel: Add basic fixed width allocator for userspace
...
We have to move process stacks to the general heap and maybe map
kernel to higher half.
2023-05-06 19:58:08 +03:00
9c07add00f
Kernel: Invalid physical addresses from heap are specified now by 0
2023-05-06 17:34:22 +03:00
ab8aac7dcf
Kernel: GDT tss selector is now 16 bit value
2023-05-06 17:34:22 +03:00
f36b94d039
Kernel: MMU can now provide info about virtual address space
2023-05-06 17:34:22 +03:00
92daa831d1
Kernel: ISRs now print pid and tid
2023-05-06 00:10:15 +03:00
e7a170c89f
Kernel: 64 bit MMU now properly identity maps kernel
2023-05-05 14:19:28 +03:00
3c5d3eb8ad
Kernel: TTY input process is now single instance
...
Process sends key events to the active (currently only) tty
2023-04-30 16:11:14 +03:00
55bb0084aa
Kernel: namespace and function renames
...
MMU moved to namespace kernel
Kernel::Memory::Heap moved to just Kernel
MMU::map_{page,range} renamed to identity_map_{page,range}
Add MMU::get_page_flags
2023-04-28 14:48:38 +03:00
acf5660090
Kernel: Add set_tss_stack() to 32 bit
2023-04-28 14:44:23 +03:00
9d7530662f
Kernel: dprintln file name is now relative
...
This makes file names much shorter
2023-04-28 14:43:19 +03:00
a22caa38d2
Kernel: Scheduler updates tss stack on thread execution
2023-04-25 14:49:50 +03:00
dc0f8b383f
Kernel: Usespace threads now have an interrupt stack
2023-04-25 14:49:18 +03:00
f1a0625b61
Kernel: TSS stack can be set after initialization
2023-04-25 14:48:12 +03:00
02b961fd7e
Kernel: Stack pointer out of bounds now panics with a message
2023-04-25 13:40:55 +03:00
6e01e04922
Kernel: Fix bug in Process::create_userspace()
...
We used to write more than we needed to. This could lead to unwanted
page faults
2023-04-25 13:21:28 +03:00
b7c2ea8d46
Kernel: Fix possible dead lock in Process::read()
2023-04-23 14:46:18 +03:00
cd74b2167d
LibC: Write mostly functioning stdio
2023-04-23 14:32:37 +03:00
9b2a577fc3
Kernel: Add ASSERTion to Process::exit()
...
This is just so I don't forget that exit can currently only
be called on the executing thread itself
2023-04-22 19:05:27 +03:00
2dd09163e6
Kernel: Process can now load 32 bit elf files on i386
...
We are page faulting on process exit but I'm investigating
the reason.
2023-04-22 19:03:30 +03:00
fb6add2b4a
Kernel: Fix 32 bit MMU
2023-04-22 18:22:39 +03:00
48445f12ac
Kernel: More proper paging in Elf loading
2023-04-22 18:17:44 +03:00
792fad2a03
Kernel: d{print,warn,error}ln(...) now has a spinlock
2023-04-22 17:58:51 +03:00
cc04990ce3
Kernel: Process now frees up its pages on destruction
2023-04-22 16:54:46 +03:00
7530482cc2
Kernel: Cleanup process creation for userspace
2023-04-22 16:51:50 +03:00
33d8c518e9
Kernel: Fix some deadlocks in the Process
2023-04-22 16:19:57 +03:00
e0ce2394fe
Kernel: Remove obsolete userspace stuff from kernel
2023-04-22 15:38:45 +03:00
fadce063a7
Kernel: Usespace programs are now ran through ELF files
...
only 64 bit elf files are supported for now.
2023-04-22 15:35:32 +03:00
26fe6ad898
Kernel: kmalloc does not dump stack trace
...
dump_stack_trace() page faults and i dont feel like debugging this
now :)
2023-04-21 13:45:13 +03:00
fc71d2f7c4
Kernel: Don't call 'cli' on interrupt
...
This is automatically done because we are using interrupt gates
in the IDT
2023-04-21 11:18:08 +03:00
35e949ef5e
Kernel: Fix syscall return value in 32 bit
2023-04-21 11:08:02 +03:00
9c506ef85b
Kernel: Stack pointer is validated when updated
...
This allows us not to fail stack pointer when in syscall since
interrupts use their own stack
2023-04-21 10:40:24 +03:00
b1c7af38d0
Kernel: Add barebones per process virtual addresses
...
We now assign every (userspace) process its own MMU which we load
in scheduler. This allows every process to have separate virtual
address space.
This is very hackish implementations but it works for now
2023-04-20 00:45:41 +03:00
ea0c9b639f
Kernel: Add some bareboness functionality to map virtual addresses
2023-04-19 23:51:36 +03:00
0030f035be
Kernel: Rename MMU::{un,}allocate... to MMU::{un,}map
...
This is more appropriate name for the behaviour :D
2023-04-19 21:50:30 +03:00
c26529ae86
Kernel: kmalloc will always print debug on failed alloc
2023-04-19 18:05:01 +03:00
e8a0df54b1
Kernel: ATAController will fail to initialize in native mode
2023-04-19 17:29:36 +03:00
33393335c8
Kernel: PCI devices now report their prog_if
2023-04-19 16:43:05 +03:00
c5b02bb9f5
Kernel: Shell fix file reading
...
We were reading 8 bytes at a time instead of the 1024 we were
supposed to :DD
2023-04-19 14:09:23 +03:00
a1047918d2
Kernel: Shell now has exit() command
2023-04-19 12:53:09 +03:00
fd81e31050
Kernel: Fix Process::exit() and where it is called from
...
cksum doesn't seem to work anymore on big files. I have to look
into this. It locks up after couple of seconds...
2023-04-19 12:52:21 +03:00
dcce18799f
Kernel: We now launch Shell again on boot
...
Adding this just before push :D
2023-04-19 00:41:24 +03:00
a9a15ea2c0
Kernel: init2 is now launched as a process instead of thread
...
Also only process can now add threads to scheduler. Nobody should
have raw access to scheduler and everything should be through
Process::current() or irqs (reschedules)
2023-04-19 00:39:06 +03:00
d63716db96
Kernel: Process is not reference counted any more
...
This was not necessary and it made things needlessly complicated
2023-04-19 00:34:18 +03:00
96ac072166
Kernel: Heap allows us to take free pages.
...
The API is kinda weird and will probably be reworked in near future
but this will work for now :)
2023-04-18 10:18:15 +03:00
295a27f16a
Kernel: Panic wont print stacktrace if it has already paniced
...
This prevents stack trace dump to panic and loop
2023-04-18 10:18:15 +03:00
88f60b5e41
Kernel: Map all ACPI tables on initialization
...
This makes their usage much easier and less error prone
They won't mapped be processes when we get to there, so this won't be
a problem
2023-04-18 10:18:15 +03:00
d23604b0d5
Kernel: Handle some Heap edge cases
2023-04-18 10:18:15 +03:00
c5347e6707
Kernel: Reorder boot initialization
...
We now create the TTY as soon as possible so we can show console
output without serial port.
2023-04-18 10:18:15 +03:00
bf0c7b9ae8
Kernel: Heap implementation can now give free pages from all of RAM
2023-04-18 10:18:15 +03:00
0374b68fa1
Kernel: Remove unused file
2023-04-18 10:18:15 +03:00
633929629c
Kernel: Start working on heap
2023-04-18 10:18:15 +03:00
6a3b3213cf
Kernel: Kmalloc now has its memory statically allocated
...
We don't use the memory map given by bootloader since this automatically
maps the memory to a available space.
2023-04-18 10:18:15 +03:00
fdb4eb6042
Kernel: Move kmalloc and MMU to Memory directory
2023-04-18 10:18:15 +03:00
998ae511a3
LibELF: Start implementing elf library
2023-04-18 10:18:15 +03:00
3f9d6f0311
LibC: add needed stubs to build executables with our compiler
2023-04-12 17:53:02 +03:00
8ee63f8264
Kernel: We can create basic userspace processes
...
These are still allocated on the kernel memory
2023-04-12 17:52:36 +03:00
34358b8471
Kernel: Scheduler can now terminate processes threads
2023-04-12 17:49:04 +03:00
5b1af4ec47
Kernel: Debug::dump_stack_trace now 'detects' repeating function
2023-04-12 01:32:41 +03:00
071d7af58a
Kernel: kmalloc does not check for corruptiong unless it cannot allocate
...
We 'don't care' if kmalloc is corrupted unless it prevents us from
allocating memory. Scheduler should be catching stack overflows either
way and is much more efficient
2023-04-12 00:24:02 +03:00
3201c3654e
Kernel: Threads now use only 4 KiB stack :)
2023-04-12 00:22:08 +03:00
6ed3023725
Kernel: Fix TTY spinlock usage
2023-04-12 00:20:04 +03:00
892a63aec5
Kernel: Shell TTY_PRINT is now function instead of macro
...
This makes functions uses way less stack
2023-04-12 00:18:58 +03:00
3fe889d4a4
BuildSystem: GCC will now complain on functions with 1 KiB stack
2023-04-12 00:18:06 +03:00
cafd546ce8
Kernel: kmalloc now detects corruption
...
Kmalloc checks if its nodes have corrupted. This was happening
because of stack overflow.
2023-04-11 23:36:46 +03:00
5810a77cbf
Kernel: Mark Scheduler::start() as noreturn as appropriate
2023-04-11 23:33:20 +03:00
6f7045ead2
Kernel: kernel doesn't allocate large blocks of data on stack
...
We used to allocate 1 KiB blocks on multiple places on stack. This
is a problem, since kernel stack shouldn't have to be too big
2023-04-11 23:31:58 +03:00
40f9a42c00
Kernel: Scheduler will panic if it encounters stack overflow
2023-04-11 23:29:21 +03:00
9abe1f27bb
Kernel: Process now locks the mutex while modifying open files
...
This allows processes to be actually removed from the list instead
of dead locking
2023-04-11 23:28:16 +03:00
aa2aee684b
Kernel: remove message from BAN::Error
...
We don't store the error message anymore in BAN::Error.
Instead we store a error code that can be mapped into a string.
This allows BAN::Error to only take 4 bytes instead of 128.
We should also make some kernel initialization just panic instead
of returning errors since they are required for succesfull boot
anyway.
2023-04-11 23:25:21 +03:00
cfa025acae
BAN: Move RefPtr to its own file and create New.h
...
New.h contains definitions for placement new operators and
BAN::allocator and BAN::dealloctor
2023-04-10 21:07:25 +03:00
781cc78a1f
BuildSystem: Fix header copying to sysroot
...
We used to copy all headers everytime to sysroot which caused
rebuild of the whole os. Now we use the cmake command
'copy_directory_if_different' which seemed to fix this issue :)
2023-04-10 21:07:25 +03:00
f924ac9265
Kernel: Threads can now be terminated mid execution
2023-04-10 21:07:25 +03:00
df6e8a6562
Kernel: Add small wait in ATA driver before reading/writing
...
This allows bochs to boot again
2023-04-10 21:07:25 +03:00
3f01f936a1
Kernel: Fix framepointers on started threads
2023-04-10 21:07:25 +03:00
25ddc24754
BuildSystem: cmake can now build out libc
...
I can't seem to get libc++ build to work...
2023-04-10 21:07:25 +03:00
3fbee2c835
BuildSystem: remove now obsolete include directories from kernel build
2023-04-07 02:25:47 +03:00
2a8dc58b6a
BuildSystem: Cleanup cmake code
...
The buildsystem is kind of a mess. I will be writingn build
instructions soon.
2023-04-06 20:31:10 +03:00
8a8793fd2d
BuildSystem: you can now build the toolchain with cmake
2023-04-06 00:23:02 +03:00
9e0b4132ee
Kernel: Shell now somewhat functions again
...
I will not be fixing the shell implementation until I get to
userspace
2023-04-05 11:37:41 +03:00
68158324f4
Kernel: Fix TTY echo and canonical flag behaviour
2023-04-05 11:35:19 +03:00
a420be6b20
Kernel: Fix ansi control sequence cursor movement
2023-04-05 03:07:52 +03:00
f281543255
Kernel: Add tty to process and make termios modifiable
2023-04-05 02:53:28 +03:00
dcf0969e2d
Kernel: TTY now supports clearing
2023-04-05 02:04:18 +03:00
4f522d337a
Kernel: Add partial support for shell
...
We don't handle arrow keys, and the tty does not know how to clear
the screeen :D
2023-04-05 01:30:58 +03:00
af0979ec32
Kernel: Process can now initialize stdio
...
This allows the use of the fds STD{IN,OUT,ERR}_FILENO
2023-04-05 01:10:25 +03:00
7f95444bb5
Kernel: Start work on making tty a file
...
TTY is now a file that you can read from/write to. I still have
to port shell to use this new interface
2023-04-05 00:56:09 +03:00
783842bac2
Kernel: add virtual write function to inode
2023-04-03 20:29:07 +03:00
e1534ad25b
Kernel: Fix keys in PS2Keymap
2023-04-03 20:25:23 +03:00
ee1f3623ce
Kernel: Fix typo
2023-04-03 19:56:55 +03:00
dffdb51713
BuildSystem: remove non-existent file from kernel CMakeLists.txt
2023-04-03 19:02:25 +03:00
b87dae7e7c
Kernel: Device dev and rdev number is done more properly
...
Also hd* partitions are now 1 indexed instead of 0
2023-04-03 11:43:16 +03:00
2ffee63889
Kernel: Cleaner partition parsing errors
2023-04-03 09:55:49 +03:00
c936aac777
Kernel: Optimize scheduler idling
...
Now after each interrupt we will ask the scheduler to reschedule
if the current thread is the idle thread. This allows semaphore
unblocking to be practically instant when there is only one thread
executing.
Now disk reading is back to ~3 MB/s for single threaded process
2023-04-03 01:51:05 +03:00
46d65471d9
Kernel: ATA now uses irqs instead of polling
...
Reading is now much slower at ~500 kB/s it was around 3 MB/s.
This is probably mostly due semaphore blocking taking atleast
until next reschedule (1 ms itervals). This will be a problem
as long as we are using only single processor.
I could try to use {READ/WRITE}_MULTIPLE commands, but since
most of the disk reads are 2 sectors (inode block size) this
will at most double the speed.
Most efficient speed up would of course be caching disk access
data and inodes overall.
2023-04-03 00:03:38 +03:00
dcc174b62e
Kernel: Move ATADevice to its own file from ATAController
...
The API is kinda weird since device reads/writes go from
ATADevice -> ATAController -> ATADevice
but this is for now atleast necessary since ATAController has(?)
to keep all devices from using the disks at the same time
2023-04-02 18:26:19 +03:00
bdc7a99c59
Kernel: ATA controller waits now before read/write until disk is ready
...
Qemu used to freeze on disk writes but now it seems fine
2023-04-02 05:37:17 +03:00
2aad357c18
BuildSystem: building for 32-bit works now
2023-04-02 05:03:17 +03:00
4c5176f751
BuildSystem: We are now using cmake instead of plain make
...
I have been annoyed for a while since I had to build everything
when running the os since the buildsystem was really bad.
I wanted to rewrite the whole build system and changed to using cmake
:)
2023-04-02 04:07:27 +03:00
cbb0f6be9a
Kernel: cleanup includes
...
I went quickly went through all files since I found some weird
includes :D
2023-04-01 02:14:49 +03:00
a60f8098ee
Kernel: Fix traversing back from mount points
2023-04-01 01:54:35 +03:00
8bffbf64b9
Kernel: Add inodes '.' and '..' to device manager
2023-04-01 01:33:04 +03:00
d91a5bccf4
Kernel: Reads return 0 bytes read at the end of device
...
We used to not have any idea if we where already at the end of device.
Also fixed couple of copy-paste errors from read->write
2023-04-01 00:55:07 +03:00
1ca0d3a3c1
Kernel: Shell cleanup cat command
2023-04-01 00:54:39 +03:00
653f688567
Kernel: Shell 'time' prints the time even if command fails
2023-04-01 00:30:33 +03:00
8b5d8d9f8a
Kernel: Process gets absolute paths for mount
2023-04-01 00:30:11 +03:00
c45ada6ccb
Kernel: fix ext2 failed creation memory leak
2023-04-01 00:22:03 +03:00
db65cfeb8a
Kernel: Cleanup ATA device initialization
2023-03-31 00:58:57 +03:00
a3ba6da6f3
Kernel: Move DeviceManager to its own file
2023-03-30 22:39:45 +03:00
b048630e5b
Kernel: Improve locking in Process, VFS and ATAController
...
We used to block on all process access. This meant that shell
reading the keyboard input would block all VFS access making disk
accesses practically impossible. We now block only when it is
necessary :)
2023-03-30 22:02:16 +03:00
dcee92a6bc
Kernel: Thread is no longer RefCounted
...
This makes developement with Scheduler much easier against compiler
optimizations. I could now remove the pragma GCC optimize stuff.
2023-03-30 19:16:51 +03:00
c2e3b422cc
Kernel: Add Semaphore to block threads
2023-03-30 18:46:33 +03:00
d4c03d3939
Kernel: root partition is now passed from the commandline
2023-03-30 18:46:19 +03:00
8e68d2e3ea
Kernel: Shell can now mount partitions
2023-03-30 15:06:41 +03:00
30c33b55e3
Kernel: Inode::Mode is now a struct so we can have functions in it
2023-03-30 14:41:15 +03:00
e2791e5260
Kernel: StorageDevices and Controllers are now devices
2023-03-30 14:22:15 +03:00
88a8bd659d
Kernel: Add IFBLK, IFLNK, IFSOCK to Inode::Mode
2023-03-30 13:15:46 +03:00
f9cc114907
Kernel: All devices have atime, mtime, ctime at their creation
2023-03-30 13:15:46 +03:00
9a4d603a62
Kernel: Remove the mount test from VFS
2023-03-30 11:43:24 +03:00
78ea4b2207
Kernel: fix stat command and device numbers
2023-03-30 10:43:08 +03:00
ab3cdea548
Kernel: Rewrite mounting code
2023-03-29 21:34:48 +03:00
dd84a2175f
Kernel: Move Partition out of StorageDevice and rename functions
2023-03-29 13:23:01 +03:00
ae05ad3f38
Kernel: Shell commands 'ls' and 'stat' recognize character devices
2023-03-29 11:56:33 +03:00
62fb233eb1
Kernel: DeviceManager is now a 'FileSystem' so it can expose devices
...
Shell reads keyboard through /dev/input :)
2023-03-29 11:50:46 +03:00
426b1482dd
Kernel: Fix keymap numlock behaviour
2023-03-29 03:18:22 +03:00
16d9d29971
Kernel: Remove obsolete KeyboardLayout/
...
This was used by the old input system. Currently keyboard layout is
hardcoded to finnish. But it will be reworked as something read from
the filesystem
2023-03-29 03:09:14 +03:00
fa8e921ee8
Kernel: Rework the whole input system
...
We now use Device abstraction that will allow us to provide devices
to userspace through /dev. Currently Shell reads from first and only
device (it being PS/2 Keyboard).
2023-03-29 03:05:16 +03:00
ea900ad744
Kernel: ACPI unmap_header does not do anything
...
We have to work with MMU mapping/unmapping to be user friendly
2023-03-28 02:56:44 +03:00
c7286396d8
Kernel: Move ACPI to its own file
2023-03-27 17:30:45 +03:00
666051fd34
Kernel/BAN: move unix time conversion to BAN and add stat to Shell
2023-03-27 00:49:58 +03:00
e55860eb6b
Kernel: Rework processes and VFS so we don't expose inodes
...
Everything is now done through a file descriptor.
2023-03-26 04:30:57 +03:00
1fade1aa9e
Kernel: Process::working_directory() is now thread safe
...
I realized you cannot return a stirng view and it to be thread safe
2023-03-24 01:46:25 +02:00
814f0b215d
Kernel: Create RecursiveSpinLock and add it to Process
...
We now lock every function within Proccess, just to be sure.
Recursive lock allows us to use lock from the same thread even if
we already have the spinlock locked
2023-03-24 01:32:35 +02:00
5fd26b4ea8
Kernel: Lock process functions instead of the ata controller
...
Process has to use locks at least on some functions so multithreaded
disk io is safe. This seemed to fix corrupted reads from disk
2023-03-24 01:17:39 +02:00
e5eab8bae4
Kernel: Ext2FS now does allocations better
...
We only have to allocate at the beginning of the all functions and
can properly exit before any disk reads if we run out of memory.
This makes development little bit 'harder' since the {read,write}_block
user must allocate a buffer of atleast block_size bytes.
I also made disk access to cause kernel panic on error since the error
handling during file write is something I don't want to think now.
The filesystem can easily corrupt so, I feel like when disk io starts
to fail I'll come back to this.
2023-03-23 23:22:31 +02:00
75c4f35e85
Kernel: Add possibiliity to create empty files on Ext2
...
Big rewrite for Ext2 for more easy and optimized code
2023-03-23 22:26:06 +02:00
633414bd20
Kernel: Remove block group descriptor cache from ext2fs
...
This will make improving the fs easier since we need to only update
the values on the disk
2023-03-23 18:52:58 +02:00
7ca6cd61be
Kernel: Move get_unix_time to RTC namespace
2023-03-23 18:14:51 +02:00
3ef72e8a7b
BAN: Modify Span constructors to keep constness correctly
2023-03-23 14:26:03 +02:00
9b56801c3d
Kernel: StorageDevice and Ext2 "support" writing
2023-03-23 13:04:13 +02:00
5f6c58ffd2
Kernel: Shell now prints unix time with 'date' command
2023-03-23 11:13:51 +02:00
Bananymous