disParity » General Discussion

GUI Development?

(10 posts)
  1. freehand
    Member

    First off Roland I want to thank you for such a valuable tool. I have spent the past month researching the perfect media storage solution and didn't like anything I found. I was so close to starting development on something myself and then I found your app. Worked perfectly right away!

    I was wondering if you have done any development on a GUI interface? I am starting to plan my solution and that includes developing a GUI app to run on my windows desktop. Any chance you need some help I am a fairly compentant .NET developer and wouldn't mind starting something.

    Also what are the chances of going open source? I have some really cool ideas (also a ton on this forum already) where disParity could go and if it was open source development would be faster and not so dependant on yourself.

    Thanks again for all your work till now and in the future!

    Posted 6 years ago #
  2. Roland
    Roland

    Hi Freehand, sorry to take so long to respond, I have been away on vacation all last week and just got back last night.

    So glad to hear you are finding disParity useful!

    At the moment, progress on the GUI project depends on how my work (job) is going. Lately I have been completely slammed at work (which is a good thing I guess these days) and haven't had much time to spend on disParity. So my current focus has been on minor improvements and bug fixes - we still have at least one parity corruption bug out there, but it is fiendishly hard to reproduce. I'd really like to get that one nailed before I start on anything new.

    Re: open source - I still haven't decided. Going open source was not my original intention, mostly because that imposes a lot of administrative overhead on the project that I don't feel like dealing with. It's still a possibility but I'm not ready to commit either way.

    Posted 6 years ago #
  3. freehand
    Member

    No problem, glad to know your still around and working on it when you can. Is there a discussion going on somewhere about this parity corruption bug? I didn't know there was a problem and would like be involved in getting that resolved.

    I totaly understand about the open source, it is a lot of work. I just want to be able to add some functionality to make the process easier. Right now I am looking to just be able to fool around and see what I come up with. Once what I develop is stable enough I can pass it your way? Is that something you would be open to?

    I was looking at this c# sample for creating a virtual drive in my computer. I was thinking it would be cool if I could recalculate the parity on the fly as files were added / deleted.

    Posted 6 years ago #
  4. freehand
    Member

    Actually a little more on that virtual drive idea, just so you see what I am going for.

    I am thinking of creating this virtual drive which would show all the folders/files from multiple data drives. So it would look like a single drive. My idea is to have the same functionality of WHS/DFS but I can use any windows OS (I didn't like how WHS doesn't support domain environments).

    Each data drive would be shared normaly on the network. Then a .NET app would connect to each share and create a single folder structure for the user to access through the virtual drive. Detecting file changes would then be very simple and parity could be updated. I was also thinking of an idea where if a user deleted a file it would update parity before actually deleting the file. I believe right now if a file is deleted and then a drive failed you would be able to recover everything except the size of the deleted file.

    Just some ideas I have been thinking about...

    Posted 6 years ago #
  5. Roland
    Roland

    The bug thread is "Verify errors", here:

    http://www.vilett.com/disParity/forum/topic.php?id=46

    The bug has only been seen twice so far and in both cases it seemed to involve very large bulk moves of files from one drive to another at some point before an update. I don't know whether the bug occurs on the next update after the large move, or on some further update after that. I added special code to my copy of disParity here that double checks all touched parity blocks after every update, which in theory will catch the bug immediately after it happens. But the bug hasn't happened to me again yet so I haven't learned anything new.

    Interesting ideas about the virtual drive project, sounds like something that could be useful to anyone who doesn't want to mess around with WHS.

    On-the-fly updates are tricky. There are basically two possible approaches: notice file changes "before" they happen, or "after". Trapping deletes before the file is deleted is nice because it makes the parity update much simpler (no need to read all the other files involved), with the one drawback that it slows down deletes quite a bit. However the only way I know how to do this is at the driver level. I don't believe this is something that a standard Windows application can do. I don't have much experience writing drivers under Windows so there would be a significant learning curve for me to add something like that to disParity.

    The other way is to have your app be notified by Windows after changes occur. This is much simpler to do and doesn't require any fancy driver coding. However that raises some issues about the proper timing of processing file change events. You can imagine a naive approach where disParity attempts to immediately update parity in response to any file system change running into problems in a variety of situations, especially cases where large numbers of files are changed at once.

    Posted 6 years ago #
  6. Phatty2x4
    Member

    freehand,

    Take a look at this (I know it's Linux but this concept ported to windows would be outstanding!)
    mhddfs

    I believe Brahim from FlexRAID is doing the same type of thing - Check Here"

    That way you're not re-inventing the wheel. I like what you're thinking. Nice and simple consolidated view, which is something most definately needed outside of WHS!!

    Posted 6 years ago #
  7. freehand
    Member

    Thanks Roland,

    I will keep an eye out for this bug. I plan on testing disParity out a lot with my setup.

    The virtual drive code that I found is nice cause they provide a .NET dll to interface with the special driver that has already been written. So I don't have to worry about anything too complicated and just focus on file handling.

    Phatty2x4,

    Ya was looking at mhddfs and it is interesting but I really want a windows solution. I am currently using DFS to just group my drives together as a one. It is a pain but it works for now. I have to remember where to copy files.

    Ya I was looking at FlexRAID when I first started but I wasn't too impressed. Not a big Java fan so when I saw a .NET version I was sold!

    Eventually I think a virtual drive that either distributes the files across all drives evenly or has some intelligence as to where each type of file goes would work well.

    Posted 6 years ago #
  8. Phatty2x4
    Member

    Freehand,

    I'm not suggesting Linux. That was my point - to get MHDDFS ported to windows. The Linux version gives you a good start point as to what is a good working concept to go off of.

    I wasn't suggesting FlexRAID either.

    Brahim is working on this same concept. My point was - instead of reinventing the wheel (he already has the first stages of the virtual disk coded out), talk with him and see if you two could collaborate.

    Posted 6 years ago #
  9. klim
    Member

    i'm have a "proof of concept" for a disparity gui, but in a very early stage.
    my question is now, was there any work done for gui, i don't want to do it twice.

    here are some pics what exists until now:

    http://www.abload.de/img/1lbot.jpg
    http://www.abload.de/img/2fzpi.jpg
    http://www.abload.de/img/3kx4d.jpg
    http://www.abload.de/img/4vlml.jpg

    and here how it should like:
    http://www.abload.de/img/5aldf.jpg

    Posted 6 years ago #
  10. Roland
    Roland

    Klim,

    Looks good! I started fiddling with a GUI many months ago but found it was a lot of work (a lot more than the disParity engine) and I just didn't have the time to keep it up. That work is suspended indefinitely until I have more time, which probably won't be for quite a while, so don't worry about any duplication of effort.

    Personally, disParity continues to do for me what I need it to do: protect my media files. So I'm satisfied with its current state for the time being.

    Posted 6 years ago #

RSS feed for this topic

Reply

You must log in to post.