zii/DBFS
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

initial commit (wip)

Browse Source
This commit is contained in:
Maurice ONeal 2022-07-08 19:21:43 -04:00
commit b66c2b92ab
27 changed files with 5219 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

73
.gitignore vendored Normal file
View File

@ -0,0 +1,73 @@
# This file is used to ignore files which are generated
# ----------------------------------------------------------------------------
*~
*.autosave
*.a
*.core
*.moc
*.o
*.obj
*.orig
*.rej
*.so
*.so.*
*_pch.h.cpp
*_resource.rc
*.qm
.#*
*.*#
core
!core/
tags
.DS_Store
.directory
*.debug
Makefile*
*.prl
*.app
moc_*.cpp
ui_*.h
qrc_*.cpp
Thumbs.db
*.res
*.rc
/.qmake.cache
/.qmake.stash
# qtcreator generated files
*.pro.user*
# xemacs temporary files
*.flc
# Vim temporary files
.*.swp
# Visual Studio generated files
*.ib_pdb_index
*.idb
*.ilk
*.pdb
*.sln
*.suo
*.vcproj
*vcproj.*.*.user
*.ncb
*.sdf
*.opensdf
*.vcxproj
*vcxproj.*
# MinGW generated files
*.Debug
*.Release
# Python byte code
*.pyc
# Binaries
# --------
*.dll
*.exe

41
DBFS.pro Normal file
View File

@ -0,0 +1,41 @@
QT -= gui
QT += sql
CONFIG += c++11 console
CONFIG -= app_bundle
LIBS += -lfuse3
win32 {
TARGET = dbfs
DESTDIR_TARGET = build\\windows\\dbfs.exe
OBJECTS_DIR = build\\windows
MOC_DIR = build\\windows
RCC_DIR = build\\windows
DESTDIR = build\\windows
} else {
TARGET = build/linux/dbfs
OBJECTS_DIR = build/linux
MOC_DIR = build/linux
RCC_DIR = build/linux
}
HEADERS += \
src/common.h \
src/db.h \
src/fuse_func.h \
src/unix_signal.h
SOURCES += \
src/common.cpp \
src/db.cpp \
src/fuse_func.cpp \
src/main.cpp \
src/unix_signal.cpp
RESOURCES += \
docs.qrc

621
LICENSE.md Normal file
View File

@ -0,0 +1,621 @@
GNU GENERAL PUBLIC LICENSE
Version 3, 29 June 2007
Copyright (C) 2007 Free Software Foundation, Inc. <http://fsf.org/>
Everyone is permitted to copy and distribute verbatim copies
of this license document, but changing it is not allowed.
Preamble
The GNU General Public License is a free, copyleft license for
software and other kinds of works.
The licenses for most software and other practical works are designed
to take away your freedom to share and change the works. By contrast,
the GNU General Public License is intended to guarantee your freedom to
share and change all versions of a program--to make sure it remains free
software for all its users. We, the Free Software Foundation, use the
GNU General Public License for most of our software; it applies also to
any other work released this way by its authors. You can apply it to
your programs, too.
When we speak of free software, we are referring to freedom, not
price. Our General Public Licenses are designed to make sure that you
have the freedom to distribute copies of free software (and charge for
them if you wish), that you receive source code or can get it if you
want it, that you can change the software or use pieces of it in new
free programs, and that you know you can do these things.
To protect your rights, we need to prevent others from denying you
these rights or asking you to surrender the rights. Therefore, you have
certain responsibilities if you distribute copies of the software, or if
you modify it: responsibilities to respect the freedom of others.
For example, if you distribute copies of such a program, whether
gratis or for a fee, you must pass on to the recipients the same
freedoms that you received. You must make sure that they, too, receive
or can get the source code. And you must show them these terms so they
know their rights.
Developers that use the GNU GPL protect your rights with two steps:
(1) assert copyright on the software, and (2) offer you this License
giving you legal permission to copy, distribute and/or modify it.
For the developers' and authors' protection, the GPL clearly explains
that there is no warranty for this free software. For both users' and
authors' sake, the GPL requires that modified versions be marked as
changed, so that their problems will not be attributed erroneously to
authors of previous versions.
Some devices are designed to deny users access to install or run
modified versions of the software inside them, although the manufacturer
can do so. This is fundamentally incompatible with the aim of
protecting users' freedom to change the software. The systematic
pattern of such abuse occurs in the area of products for individuals to
use, which is precisely where it is most unacceptable. Therefore, we
have designed this version of the GPL to prohibit the practice for those
products. If such problems arise substantially in other domains, we
stand ready to extend this provision to those domains in future versions
of the GPL, as needed to protect the freedom of users.
Finally, every program is threatened constantly by software patents.
States should not allow patents to restrict development and use of
software on general-purpose computers, but in those that do, we wish to
avoid the special danger that patents applied to a free program could
make it effectively proprietary. To prevent this, the GPL assures that
patents cannot be used to render the program non-free.
The precise terms and conditions for copying, distribution and
modification follow.
TERMS AND CONDITIONS
0. Definitions.
"This License" refers to version 3 of the GNU General Public License.
"Copyright" also means copyright-like laws that apply to other kinds of
works, such as semiconductor masks.
"The Program" refers to any copyrightable work licensed under this
License. Each licensee is addressed as "you". "Licensees" and
"recipients" may be individuals or organizations.
To "modify" a work means to copy from or adapt all or part of the work
in a fashion requiring copyright permission, other than the making of an
exact copy. The resulting work is called a "modified version" of the
earlier work or a work "based on" the earlier work.
A "covered work" means either the unmodified Program or a work based
on the Program.
To "propagate" a work means to do anything with it that, without
permission, would make you directly or secondarily liable for
infringement under applicable copyright law, except executing it on a
computer or modifying a private copy. Propagation includes copying,
distribution (with or without modification), making available to the
public, and in some countries other activities as well.
To "convey" a work means any kind of propagation that enables other
parties to make or receive copies. Mere interaction with a user through
a computer network, with no transfer of a copy, is not conveying.
An interactive user interface displays "Appropriate Legal Notices"
to the extent that it includes a convenient and prominently visible
feature that (1) displays an appropriate copyright notice, and (2)
tells the user that there is no warranty for the work (except to the
extent that warranties are provided), that licensees may convey the
work under this License, and how to view a copy of this License. If
the interface presents a list of user commands or options, such as a
menu, a prominent item in the list meets this criterion.
1. Source Code.
The "source code" for a work means the preferred form of the work
for making modifications to it. "Object code" means any non-source
form of a work.
A "Standard Interface" means an interface that either is an official
standard defined by a recognized standards body, or, in the case of
interfaces specified for a particular programming language, one that
is widely used among developers working in that language.
The "System Libraries" of an executable work include anything, other
than the work as a whole, that (a) is included in the normal form of
packaging a Major Component, but which is not part of that Major
Component, and (b) serves only to enable use of the work with that
Major Component, or to implement a Standard Interface for which an
implementation is available to the public in source code form. A
"Major Component", in this context, means a major essential component
(kernel, window system, and so on) of the specific operating system
(if any) on which the executable work runs, or a compiler used to
produce the work, or an object code interpreter used to run it.
The "Corresponding Source" for a work in object code form means all
the source code needed to generate, install, and (for an executable
work) run the object code and to modify the work, including scripts to
control those activities. However, it does not include the work's
System Libraries, or general-purpose tools or generally available free
programs which are used unmodified in performing those activities but
which are not part of the work. For example, Corresponding Source
includes interface definition files associated with source files for
the work, and the source code for shared libraries and dynamically
linked subprograms that the work is specifically designed to require,
such as by intimate data communication or control flow between those
subprograms and other parts of the work.
The Corresponding Source need not include anything that users
can regenerate automatically from other parts of the Corresponding
Source.
The Corresponding Source for a work in source code form is that
same work.
2. Basic Permissions.
All rights granted under this License are granted for the term of
copyright on the Program, and are irrevocable provided the stated
conditions are met. This License explicitly affirms your unlimited
permission to run the unmodified Program. The output from running a
covered work is covered by this License only if the output, given its
content, constitutes a covered work. This License acknowledges your
rights of fair use or other equivalent, as provided by copyright law.
You may make, run and propagate covered works that you do not
convey, without conditions so long as your license otherwise remains
in force. You may convey covered works to others for the sole purpose
of having them make modifications exclusively for you, or provide you
with facilities for running those works, provided that you comply with
the terms of this License in conveying all material for which you do
not control copyright. Those thus making or running the covered works
for you must do so exclusively on your behalf, under your direction
and control, on terms that prohibit them from making any copies of
your copyrighted material outside their relationship with you.
Conveying under any other circumstances is permitted solely under
the conditions stated below. Sublicensing is not allowed; section 10
makes it unnecessary.
3. Protecting Users' Legal Rights From Anti-Circumvention Law.
No covered work shall be deemed part of an effective technological
measure under any applicable law fulfilling obligations under article
11 of the WIPO copyright treaty adopted on 20 December 1996, or
similar laws prohibiting or restricting circumvention of such
measures.
When you convey a covered work, you waive any legal power to forbid
circumvention of technological measures to the extent such circumvention
is effected by exercising rights under this License with respect to
the covered work, and you disclaim any intention to limit operation or
modification of the work as a means of enforcing, against the work's
users, your or third parties' legal rights to forbid circumvention of
technological measures.
4. Conveying Verbatim Copies.
You may convey verbatim copies of the Program's source code as you
receive it, in any medium, provided that you conspicuously and
appropriately publish on each copy an appropriate copyright notice;
keep intact all notices stating that this License and any
non-permissive terms added in accord with section 7 apply to the code;
keep intact all notices of the absence of any warranty; and give all
recipients a copy of this License along with the Program.
You may charge any price or no price for each copy that you convey,
and you may offer support or warranty protection for a fee.
5. Conveying Modified Source Versions.
You may convey a work based on the Program, or the modifications to
produce it from the Program, in the form of source code under the
terms of section 4, provided that you also meet all of these conditions:
a) The work must carry prominent notices stating that you modified
it, and giving a relevant date.
b) The work must carry prominent notices stating that it is
released under this License and any conditions added under section
7. This requirement modifies the requirement in section 4 to
"keep intact all notices".
c) You must license the entire work, as a whole, under this
License to anyone who comes into possession of a copy. This
License will therefore apply, along with any applicable section 7
additional terms, to the whole of the work, and all its parts,
regardless of how they are packaged. This License gives no
permission to license the work in any other way, but it does not
invalidate such permission if you have separately received it.
d) If the work has interactive user interfaces, each must display
Appropriate Legal Notices; however, if the Program has interactive
interfaces that do not display Appropriate Legal Notices, your
work need not make them do so.
A compilation of a covered work with other separate and independent
works, which are not by their nature extensions of the covered work,
and which are not combined with it such as to form a larger program,
in or on a volume of a storage or distribution medium, is called an
"aggregate" if the compilation and its resulting copyright are not
used to limit the access or legal rights of the compilation's users
beyond what the individual works permit. Inclusion of a covered work
in an aggregate does not cause this License to apply to the other
parts of the aggregate.
6. Conveying Non-Source Forms.
You may convey a covered work in object code form under the terms
of sections 4 and 5, provided that you also convey the
machine-readable Corresponding Source under the terms of this License,
in one of these ways:
a) Convey the object code in, or embodied in, a physical product
(including a physical distribution medium), accompanied by the
Corresponding Source fixed on a durable physical medium
customarily used for software interchange.
b) Convey the object code in, or embodied in, a physical product
(including a physical distribution medium), accompanied by a
written offer, valid for at least three years and valid for as
long as you offer spare parts or customer support for that product
model, to give anyone who possesses the object code either (1) a
copy of the Corresponding Source for all the software in the
product that is covered by this License, on a durable physical
medium customarily used for software interchange, for a price no
more than your reasonable cost of physically performing this
conveying of source, or (2) access to copy the
Corresponding Source from a network server at no charge.
c) Convey individual copies of the object code with a copy of the
written offer to provide the Corresponding Source. This
alternative is allowed only occasionally and noncommercially, and
only if you received the object code with such an offer, in accord
with subsection 6b.
d) Convey the object code by offering access from a designated
place (gratis or for a charge), and offer equivalent access to the
Corresponding Source in the same way through the same place at no
further charge. You need not require recipients to copy the
Corresponding Source along with the object code. If the place to
copy the object code is a network server, the Corresponding Source
may be on a different server (operated by you or a third party)
that supports equivalent copying facilities, provided you maintain
clear directions next to the object code saying where to find the
Corresponding Source. Regardless of what server hosts the
Corresponding Source, you remain obligated to ensure that it is
available for as long as needed to satisfy these requirements.
e) Convey the object code using peer-to-peer transmission, provided
you inform other peers where the object code and Corresponding
Source of the work are being offered to the general public at no
charge under subsection 6d.
A separable portion of the object code, whose source code is excluded
from the Corresponding Source as a System Library, need not be
included in conveying the object code work.
A "User Product" is either (1) a "consumer product", which means any
tangible personal property which is normally used for personal, family,
or household purposes, or (2) anything designed or sold for incorporation
into a dwelling. In determining whether a product is a consumer product,
doubtful cases shall be resolved in favor of coverage. For a particular
product received by a particular user, "normally used" refers to a
typical or common use of that class of product, regardless of the status
of the particular user or of the way in which the particular user
actually uses, or expects or is expected to use, the product. A product
is a consumer product regardless of whether the product has substantial
commercial, industrial or non-consumer uses, unless such uses represent
the only significant mode of use of the product.
"Installation Information" for a User Product means any methods,
procedures, authorization keys, or other information required to install
and execute modified versions of a covered work in that User Product from
a modified version of its Corresponding Source. The information must
suffice to ensure that the continued functioning of the modified object
code is in no case prevented or interfered with solely because
modification has been made.
If you convey an object code work under this section in, or with, or
specifically for use in, a User Product, and the conveying occurs as
part of a transaction in which the right of possession and use of the
User Product is transferred to the recipient in perpetuity or for a
fixed term (regardless of how the transaction is characterized), the
Corresponding Source conveyed under this section must be accompanied
by the Installation Information. But this requirement does not apply
if neither you nor any third party retains the ability to install
modified object code on the User Product (for example, the work has
been installed in ROM).
The requirement to provide Installation Information does not include a
requirement to continue to provide support service, warranty, or updates
for a work that has been modified or installed by the recipient, or for
the User Product in which it has been modified or installed. Access to a
network may be denied when the modification itself materially and
adversely affects the operation of the network or violates the rules and
protocols for communication across the network.
Corresponding Source conveyed, and Installation Information provided,
in accord with this section must be in a format that is publicly
documented (and with an implementation available to the public in
source code form), and must require no special password or key for
unpacking, reading or copying.
7. Additional Terms.
"Additional permissions" are terms that supplement the terms of this
License by making exceptions from one or more of its conditions.
Additional permissions that are applicable to the entire Program shall
be treated as though they were included in this License, to the extent
that they are valid under applicable law. If additional permissions
apply only to part of the Program, that part may be used separately
under those permissions, but the entire Program remains governed by
this License without regard to the additional permissions.
When you convey a copy of a covered work, you may at your option
remove any additional permissions from that copy, or from any part of
it. (Additional permissions may be written to require their own
removal in certain cases when you modify the work.) You may place
additional permissions on material, added by you to a covered work,
for which you have or can give appropriate copyright permission.
Notwithstanding any other provision of this License, for material you
add to a covered work, you may (if authorized by the copyright holders of
that material) supplement the terms of this License with terms:
a) Disclaiming warranty or limiting liability differently from the
terms of sections 15 and 16 of this License; or
b) Requiring preservation of specified reasonable legal notices or
author attributions in that material or in the Appropriate Legal
Notices displayed by works containing it; or
c) Prohibiting misrepresentation of the origin of that material, or
requiring that modified versions of such material be marked in
reasonable ways as different from the original version; or
d) Limiting the use for publicity purposes of names of licensors or
authors of the material; or
e) Declining to grant rights under trademark law for use of some
trade names, trademarks, or service marks; or
f) Requiring indemnification of licensors and authors of that
material by anyone who conveys the material (or modified versions of
it) with contractual assumptions of liability to the recipient, for
any liability that these contractual assumptions directly impose on
those licensors and authors.
All other non-permissive additional terms are considered "further
restrictions" within the meaning of section 10. If the Program as you
received it, or any part of it, contains a notice stating that it is
governed by this License along with a term that is a further
restriction, you may remove that term. If a license document contains
a further restriction but permits relicensing or conveying under this
License, you may add to a covered work material governed by the terms
of that license document, provided that the further restriction does
not survive such relicensing or conveying.
If you add terms to a covered work in accord with this section, you
must place, in the relevant source files, a statement of the
additional terms that apply to those files, or a notice indicating
where to find the applicable terms.
Additional terms, permissive or non-permissive, may be stated in the
form of a separately written license, or stated as exceptions;
the above requirements apply either way.
8. Termination.
You may not propagate or modify a covered work except as expressly
provided under this License. Any attempt otherwise to propagate or
modify it is void, and will automatically terminate your rights under
this License (including any patent licenses granted under the third
paragraph of section 11).
However, if you cease all violation of this License, then your
license from a particular copyright holder is reinstated (a)
provisionally, unless and until the copyright holder explicitly and
finally terminates your license, and (b) permanently, if the copyright
holder fails to notify you of the violation by some reasonable means
prior to 60 days after the cessation.
Moreover, your license from a particular copyright holder is
reinstated permanently if the copyright holder notifies you of the
violation by some reasonable means, this is the first time you have
received notice of violation of this License (for any work) from that
copyright holder, and you cure the violation prior to 30 days after
your receipt of the notice.
Termination of your rights under this section does not terminate the
licenses of parties who have received copies or rights from you under
this License. If your rights have been terminated and not permanently
reinstated, you do not qualify to receive new licenses for the same
material under section 10.
9. Acceptance Not Required for Having Copies.
You are not required to accept this License in order to receive or
run a copy of the Program. Ancillary propagation of a covered work
occurring solely as a consequence of using peer-to-peer transmission
to receive a copy likewise does not require acceptance. However,
nothing other than this License grants you permission to propagate or
modify any covered work. These actions infringe copyright if you do
not accept this License. Therefore, by modifying or propagating a
covered work, you indicate your acceptance of this License to do so.
10. Automatic Licensing of Downstream Recipients.
Each time you convey a covered work, the recipient automatically
receives a license from the original licensors, to run, modify and
propagate that work, subject to this License. You are not responsible
for enforcing compliance by third parties with this License.
An "entity transaction" is a transaction transferring control of an
organization, or substantially all assets of one, or subdividing an
organization, or merging organizations. If propagation of a covered
work results from an entity transaction, each party to that
transaction who receives a copy of the work also receives whatever
licenses to the work the party's predecessor in interest had or could
give under the previous paragraph, plus a right to possession of the
Corresponding Source of the work from the predecessor in interest, if
the predecessor has it or can get it with reasonable efforts.
You may not impose any further restrictions on the exercise of the
rights granted or affirmed under this License. For example, you may
not impose a license fee, royalty, or other charge for exercise of
rights granted under this License, and you may not initiate litigation
(including a cross-claim or counterclaim in a lawsuit) alleging that
any patent claim is infringed by making, using, selling, offering for
sale, or importing the Program or any portion of it.
11. Patents.
A "contributor" is a copyright holder who authorizes use under this
License of the Program or a work on which the Program is based. The
work thus licensed is called the contributor's "contributor version".
A contributor's "essential patent claims" are all patent claims
owned or controlled by the contributor, whether already acquired or
hereafter acquired, that would be infringed by some manner, permitted
by this License, of making, using, or selling its contributor version,
but do not include claims that would be infringed only as a
consequence of further modification of the contributor version. For
purposes of this definition, "control" includes the right to grant
patent sublicenses in a manner consistent with the requirements of
this License.
Each contributor grants you a non-exclusive, worldwide, royalty-free
patent license under the contributor's essential patent claims, to
make, use, sell, offer for sale, import and otherwise run, modify and
propagate the contents of its contributor version.
In the following three paragraphs, a "patent license" is any express
agreement or commitment, however denominated, not to enforce a patent
(such as an express permission to practice a patent or covenant not to
sue for patent infringement). To "grant" such a patent license to a
party means to make such an agreement or commitment not to enforce a
patent against the party.
If you convey a covered work, knowingly relying on a patent license,
and the Corresponding Source of the work is not available for anyone
to copy, free of charge and under the terms of this License, through a
publicly available network server or other readily accessible means,
then you must either (1) cause the Corresponding Source to be so
available, or (2) arrange to deprive yourself of the benefit of the
patent license for this particular work, or (3) arrange, in a manner
consistent with the requirements of this License, to extend the patent
license to downstream recipients. "Knowingly relying" means you have
actual knowledge that, but for the patent license, your conveying the
covered work in a country, or your recipient's use of the covered work
in a country, would infringe one or more identifiable patents in that
country that you have reason to believe are valid.
If, pursuant to or in connection with a single transaction or
arrangement, you convey, or propagate by procuring conveyance of, a
covered work, and grant a patent license to some of the parties
receiving the covered work authorizing them to use, propagate, modify
or convey a specific copy of the covered work, then the patent license
you grant is automatically extended to all recipients of the covered
work and works based on it.
A patent license is "discriminatory" if it does not include within
the scope of its coverage, prohibits the exercise of, or is
conditioned on the non-exercise of one or more of the rights that are
specifically granted under this License. You may not convey a covered
work if you are a party to an arrangement with a third party that is
in the business of distributing software, under which you make payment
to the third party based on the extent of your activity of conveying
the work, and under which the third party grants, to any of the
parties who would receive the covered work from you, a discriminatory
patent license (a) in connection with copies of the covered work
conveyed by you (or copies made from those copies), or (b) primarily
for and in connection with specific products or compilations that
contain the covered work, unless you entered into that arrangement,
or that patent license was granted, prior to 28 March 2007.
Nothing in this License shall be construed as excluding or limiting
any implied license or other defenses to infringement that may
otherwise be available to you under applicable patent law.
12. No Surrender of Others' Freedom.
If conditions are imposed on you (whether by court order, agreement or
otherwise) that contradict the conditions of this License, they do not
excuse you from the conditions of this License. If you cannot convey a
covered work so as to satisfy simultaneously your obligations under this
License and any other pertinent obligations, then as a consequence you may
not convey it at all. For example, if you agree to terms that obligate you
to collect a royalty for further conveying from those to whom you convey
the Program, the only way you could satisfy both those terms and this
License would be to refrain entirely from conveying the Program.
13. Use with the GNU Affero General Public License.
Notwithstanding any other provision of this License, you have
permission to link or combine any covered work with a work licensed
under version 3 of the GNU Affero General Public License into a single
combined work, and to convey the resulting work. The terms of this
License will continue to apply to the part which is the covered work,
but the special requirements of the GNU Affero General Public License,
section 13, concerning interaction through a network will apply to the
combination as such.
14. Revised Versions of this License.
The Free Software Foundation may publish revised and/or new versions of
the GNU General Public License from time to time. Such new versions will
be similar in spirit to the present version, but may differ in detail to
address new problems or concerns.
Each version is given a distinguishing version number. If the
Program specifies that a certain numbered version of the GNU General
Public License "or any later version" applies to it, you have the
option of following the terms and conditions either of that numbered
version or of any later version published by the Free Software
Foundation. If the Program does not specify a version number of the
GNU General Public License, you may choose any version ever published
by the Free Software Foundation.
If the Program specifies that a proxy can decide which future
versions of the GNU General Public License can be used, that proxy's
public statement of acceptance of a version permanently authorizes you
to choose that version for the Program.
Later license versions may give you additional or different
permissions. However, no additional obligations are imposed on any
author or copyright holder as a result of your choosing to follow a
later version.
15. Disclaimer of Warranty.
THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY
APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT
HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY
OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO,
THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM
IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF
ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
16. Limitation of Liability.
IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS
THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE
USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF
DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD
PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS),
EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES.
17. Interpretation of Sections 15 and 16.
If the disclaimer of warranty and limitation of liability provided
above cannot be given local legal effect according to their terms,
reviewing courts shall apply local law that most closely approximates
an absolute waiver of all civil liability in connection with the
Program, unless a warranty or assumption of liability accompanies a
copy of the Program in return for a fee.
END OF TERMS AND CONDITIONS

3
app_dir/info.txt Normal file
View File

@ -0,0 +1,3 @@
dbfs
1.0
DBFS

BIN
app_dir/linux/dbfs Normal file
View File

Binary file not shown.

5
app_dir/linux/dbfs.sh Normal file
View File

@ -0,0 +1,5 @@
#!/bin/sh
export QTDIR=$install_dir
export QT_PLUGIN_PATH=$install_dir
export LD_LIBRARY_PATH="$install_dir/lib:\$LD_LIBRARY_PATH"
$install_dir/$app_target $1 $2 $3

4
app_dir/linux/uninstall.sh Normal file
View File

@ -0,0 +1,4 @@
#!/bin/sh
rm -v /usr/bin/$app_target
rm -rv $install_dir
echo "Uninstallation Complete"

277
build.py Normal file
View File

@ -0,0 +1,277 @@
#!/usr/bin/python3
import os
import re
import subprocess
import shutil
import platform
import sys
def get_app_target(text):
return re.search(r'(APP_TARGET) +(\"(.*?)\")', text).group(3)
def get_app_ver(text):
return re.search(r'(APP_VER) +(\"(.*?)\")', text).group(3)
def get_app_name(text):
return re.search(r'(APP_NAME) +(\"(.*?)\")', text).group(3)
def get_qt_path():
try:
return str(subprocess.check_output(["qtpaths", "--binaries-dir"]), 'utf-8').strip()
except:
print("A direct call to 'qtpaths' has failed so automatic retrieval of the QT bin folder is not possible.")
return input("Please enter the QT bin path (leave blank to cancel the build): ")
def get_qt_from_cli():
for arg in sys.argv:
if arg == "-qt_dir":
index = sys.argv.index(arg)
try:
return sys.argv[index + 1]
except:
return ""
return ""
def get_info_header():
current_dir = os.path.dirname(__file__)
if current_dir == "":
return "src" + os.sep + "common.h"
else:
return current_dir + os.sep + "src" + os.sep + "common.h"
def get_nearest_subdir(path, sub_name):
dir_list = os.listdir(path)
ret = ""
for entry in dir_list:
if sub_name in entry:
ret = entry
break
return ret
def get_maker(qt_path):
ret = ""
if platform.system() == "Linux":
ret = "make"
elif platform.system() == "Windows":
path = os.path.abspath(qt_path + "\\..")
name = os.path.basename(path)
if "mingw" in name:
tools_path = os.path.abspath(qt_path + "\\..\\..\\..\\Tools")
mingw_ver = name[5:7]
mingw_tool_subdir = get_nearest_subdir(tools_path, "mingw" + mingw_ver)
mingw_tool_path = tools_path + "\\" + mingw_tool_subdir + "\\bin"
if not os.environ['PATH'].endswith(";"):
os.environ['PATH'] = os.environ['PATH'] + ";"
os.environ['PATH'] = os.environ['PATH'] + mingw_tool_path
ret = "mingw32-make"
elif "msvc" in name:
print("Warning: this script will assume you already ran the VsDevCmd.bat or vsvars32.bat script files")
print(" for Microsoft Visual Studio. Either way, a call to 'nmake' should be recognizable as ")
print(" a shell command otherwise this script will fail.\n")
ans = input("If that is the case enter 'y' to continue or any other key to cancel the build: ")
if ans == 'y' or ans == 'Y':
ret = "nmake"
else:
exit()
else:
print("The system platform is unknown. Output from platform.system() = " + platform.system())
return ret
def cd():
current_dir = os.path.dirname(__file__)
if current_dir != "":
os.chdir(current_dir)
def verbose_copy(src, dst):
print("cpy: " + src + " --> " + dst)
if os.path.isdir(src):
if os.path.exists(dst) and os.path.isdir(dst):
shutil.rmtree(dst)
try:
# ignore errors thrown by shutil.copytree()
# it's likely not actually failing to copy
# the directory but still throws errors if
# it fails to apply the same file stats as
# the source. this type of errors can be
# ignored.
shutil.copytree(src, dst)
except:
pass
elif os.path.exists(src):
shutil.copyfile(src, dst)
else:
print("wrn: " + src + " does not exists. skipping.")
def linux_build_app_dir(app_ver, app_name, app_target, qt_bin):
if not os.path.exists("app_dir/linux/sqldrivers"):
os.makedirs("app_dir/linux/sqldrivers")
if not os.path.exists("app_dir/linux/lib"):
os.makedirs("app_dir/linux/lib")
verbose_copy(qt_bin + "/../plugins/sqldrivers/libqsqlite.so", "app_dir/linux/sqldrivers/libqsqlite.so")
verbose_copy(qt_bin + "/../plugins/sqldrivers/libqsqlodbc.so", "app_dir/linux/sqldrivers/libqsqlodbc.so")
verbose_copy(qt_bin + "/../plugins/sqldrivers/libqsqlpsql.so", "app_dir/linux/sqldrivers/libqsqlpsql.so")
verbose_copy(qt_bin + "/../plugins/sqldrivers/libqsqlmysql.so", "app_dir/linux/sqldrivers/libqsqlmysql.so")
verbose_copy("build/linux/" + app_target, "app_dir/linux/" + app_target)
shutil.copyfile("build/linux/" + app_target, "/tmp/" + app_target)
# copying the executable file from the build folder to
# temp bypasses any -noexe retrictions a linux file
# system may have. there is a chance temp is also
# restricted in this way but that kind of config is
# rare. ldd will not run correctly with -noexe
# enabled.
lines = str(subprocess.check_output(["ldd", "/tmp/" + app_target]), 'utf-8').split("\n")
os.remove("/tmp/" + app_target)
for line in lines:
if " => " in line:
if ("libQt" in line) or ("libicu" in line) or ("libssl" in line) or ("libcrypto" in line):
if " (0x0" in line:
start_index = line.index("> ") + 2
end_index = line.index(" (0x0")
src_file = line[start_index:end_index]
file_name = os.path.basename(src_file)
verbose_copy(src_file, "app_dir/linux/lib/" + file_name)
verbose_copy("templates/linux_run_script.sh", "app_dir/linux/" + app_target + ".sh")
verbose_copy("templates/linux_service.service", "app_dir/linux/" + app_target + ".service")
verbose_copy("templates/linux_uninstall.sh", "app_dir/linux/uninstall.sh")
complete(app_ver, app_target)
def windows_build_app_dir(app_ver, app_name, app_target, qt_bin):
if os.path.exists("release"):
os.removedirs("release")
if os.path.exists("debug"):
os.removedirs("debug")
if not os.path.exists("app_dir\\windows"):
os.makedirs("app_dir\\windows")
verbose_copy("build\\windows\\" + app_target + ".exe", "app_dir\\windows\\" + app_target + ".exe")
verbose_copy("templates\\windows_uninstall.bat", "app_dir\\windows\\uninstall.bat")
verbose_copy("templates\\windows_shtask.xml", "app_dir\\windows\\shtask.xml")
os.chdir("app_dir\\windows\\")
result = subprocess.run([qt_bin + "\\" + "windeployqt", app_target + ".exe"])
cd()
if result.returncode == 0:
complete(app_ver, app_target)
def complete(app_ver, app_target):
if os.path.exists("Makefile"):
os.remove("Makefile")
if os.path.exists("Makefile.Debug"):
os.remove("Makefile.Debug")
if os.path.exists("Makefile.Release"):
os.remove("Makefile.Release")
if os.path.exists("object_script." + app_target + ".Debug"):
os.remove("object_script." + app_target + ".Debug")
if os.path.exists("object_script." + app_target + ".Release"):
os.remove("object_script." + app_target + ".Release")
print("Build complete for version: " + app_ver)
print("You can now run the install.py script to install onto this machine or create an installer.")
def main():
with open(get_info_header()) as file:
text = file.read()
app_target = get_app_target(text)
app_ver = get_app_ver(text)
app_name = get_app_name(text)
qt_bin = get_qt_from_cli()
if qt_bin == "":
qt_bin = get_qt_path()
maker = get_maker(qt_bin)
if qt_bin != "":
print("app_target = " + app_target)
print("app_version = " + app_ver)
print("app_name = " + app_name)
print("qt_bin = " + qt_bin)
print("maker = " + maker + "\n")
if maker == "":
print("Could not find a valid maker/compiler on this platform, unable to continue.")
else:
cd()
if platform.system() == "Linux":
if os.path.exists("build/linux"):
shutil.rmtree("build/linux")
elif platform.system() == "Windows":
if os.path.exists("build/windows"):
shutil.rmtree("build/windows")
result = subprocess.run([qt_bin + os.sep + "qmake", "-config", "release"])
if result.returncode == 0:
result = subprocess.run([maker])
if result.returncode == 0:
if not os.path.exists("app_dir"):
os.makedirs("app_dir")
with open("app_dir" + os.sep + "info.txt", "w") as info_file:
info_file.write(app_target + "\n")
info_file.write(app_ver + "\n")
info_file.write(app_name + "\n")
if platform.system() == "Linux":
linux_build_app_dir(app_ver, app_name, app_target, qt_bin)
elif platform.system() == "Windows":
windows_build_app_dir(app_ver, app_name, app_target, qt_bin)
else:
print("The platform you are running in is not compatible with the app_dir build out procedure.")
print(" output from platform.system() = " + platform.system())
if __name__ == "__main__":
main()

BIN
build/linux/dbfs Normal file
View File

Binary file not shown.

417
build/linux/moc_predefs.h Normal file
View File

@ -0,0 +1,417 @@
#define __SSP_STRONG__ 3
#define __DBL_MIN_EXP__ (-1021)
#define __cpp_attributes 200809L
#define __cpp_nontype_template_parameter_auto 201606L
#define __UINT_LEAST16_MAX__ 0xffff
#define __ATOMIC_ACQUIRE 2
#define __FLT128_MAX_10_EXP__ 4932
#define __FLT_MIN__ 1.17549435082228750796873653722224568e-38F
#define __GCC_IEC_559_COMPLEX 2
#define __cpp_aggregate_nsdmi 201304L
#define __UINT_LEAST8_TYPE__ unsigned char
#define __SIZEOF_FLOAT80__ 16
#define __INTMAX_C(c) c ## L
#define __CHAR_BIT__ 8
#define __UINT8_MAX__ 0xff
#define __SCHAR_WIDTH__ 8
#define __WINT_MAX__ 0xffffffffU
#define __FLT32_MIN_EXP__ (-125)
#define __cpp_static_assert 201411L
#define __ORDER_LITTLE_ENDIAN__ 1234
#define __SIZE_MAX__ 0xffffffffffffffffUL
#define __WCHAR_MAX__ 0x7fffffff
#define __GCC_HAVE_SYNC_COMPARE_AND_SWAP_1 1
#define __GCC_HAVE_SYNC_COMPARE_AND_SWAP_2 1
#define __GCC_HAVE_SYNC_COMPARE_AND_SWAP_4 1
#define __DBL_DENORM_MIN__ double(4.94065645841246544176568792868221372e-324L)
#define __GCC_HAVE_SYNC_COMPARE_AND_SWAP_8 1
#define __GCC_ATOMIC_CHAR_LOCK_FREE 2
#define __GCC_IEC_559 2
#define __FLT32X_DECIMAL_DIG__ 17
#define __FLT_EVAL_METHOD__ 0
#define __cpp_binary_literals 201304L
#define __FLT64_DECIMAL_DIG__ 17
#define __CET__ 3
#define __cpp_noexcept_function_type 201510L
#define __GCC_ATOMIC_CHAR32_T_LOCK_FREE 2
#define __cpp_variadic_templates 200704L
#define __UINT_FAST64_MAX__ 0xffffffffffffffffUL
#define __SIG_ATOMIC_TYPE__ int
#define __DBL_MIN_10_EXP__ (-307)
#define __FINITE_MATH_ONLY__ 0
#define __cpp_variable_templates 201304L
#define __FLT32X_MAX_EXP__ 1024
#define __FLT32_HAS_DENORM__ 1
#define __UINT_FAST8_MAX__ 0xff
#define __cpp_rvalue_reference 200610L
#define __cpp_nested_namespace_definitions 201411L
#define __DEC64_MAX_EXP__ 385
#define __INT8_C(c) c
#define __INT_LEAST8_WIDTH__ 8
#define __cpp_variadic_using 201611L
#define __UINT_LEAST64_MAX__ 0xffffffffffffffffUL
#define __cpp_capture_star_this 201603L
#define __SHRT_MAX__ 0x7fff
#define __LDBL_MAX__ 1.18973149535723176502126385303097021e+4932L
#define __FLT64X_MAX_10_EXP__ 4932
#define __cpp_if_constexpr 201606L
#define __FLT64X_HAS_QUIET_NAN__ 1
#define __UINT_LEAST8_MAX__ 0xff
#define __GCC_ATOMIC_BOOL_LOCK_FREE 2
#define __FLT128_DENORM_MIN__ 6.47517511943802511092443895822764655e-4966F128
#define __UINTMAX_TYPE__ long unsigned int
#define __linux 1
#define __DEC32_EPSILON__ 1E-6DF
#define __FLT_EVAL_METHOD_TS_18661_3__ 0
#define __OPTIMIZE__ 1
#define __unix 1
#define __UINT32_MAX__ 0xffffffffU
#define __GXX_EXPERIMENTAL_CXX0X__ 1
#define __FLT128_MIN_EXP__ (-16381)
#define __WINT_MIN__ 0U
#define __FLT128_MIN_10_EXP__ (-4931)
#define __INT_LEAST16_WIDTH__ 16
#define __SCHAR_MAX__ 0x7f
#define __FLT128_MANT_DIG__ 113
#define __WCHAR_MIN__ (-__WCHAR_MAX__ - 1)
#define __INT64_C(c) c ## L
#define __GCC_ATOMIC_POINTER_LOCK_FREE 2
#define _FORTIFY_SOURCE 2
#define __FLT32X_MANT_DIG__ 53
#define __GCC_ATOMIC_CHAR16_T_LOCK_FREE 2
#define __cpp_aligned_new 201606L
#define __USER_LABEL_PREFIX__
#define __FLT32_MAX_10_EXP__ 38
#define __FLT64X_EPSILON__ 1.08420217248550443400745280086994171e-19F64x
#define __STDC_HOSTED__ 1
#define __DEC64_MIN_EXP__ (-382)
#define __cpp_decltype_auto 201304L
#define __DBL_DIG__ 15
#define __FLT32_DIG__ 6
#define __FLT_EPSILON__ 1.19209289550781250000000000000000000e-7F
#define __GXX_WEAK__ 1
#define __SHRT_WIDTH__ 16
#define __FLT32_MAX_EXP__ 128
#define __LDBL_MIN__ 3.36210314311209350626267781732175260e-4932L
#define __DEC32_MAX__ 9.999999E96DF
#define __cpp_threadsafe_static_init 200806L
#define __cpp_enumerator_attributes 201411L
#define __FLT64X_DENORM_MIN__ 3.64519953188247460252840593361941982e-4951F64x
#define __FLT32X_HAS_INFINITY__ 1
#define __INT32_MAX__ 0x7fffffff
#define __unix__ 1
#define __INT_WIDTH__ 32
#define __SIZEOF_LONG__ 8
#define __STDC_IEC_559__ 1
#define __STDC_ISO_10646__ 201706L
#define __UINT16_C(c) c
#define __DECIMAL_DIG__ 21
#define __STDC_IEC_559_COMPLEX__ 1
#define __FLT64_EPSILON__ 2.22044604925031308084726333618164062e-16F64
#define __gnu_linux__ 1
#define __INT16_MAX__ 0x7fff
#define __FLT64_MIN_EXP__ (-1021)
#define __FLT64X_MIN_10_EXP__ (-4931)
#define __LDBL_HAS_QUIET_NAN__ 1
#define __FLT64_MANT_DIG__ 53
#define __FLT64X_MANT_DIG__ 64
#define __GNUC__ 10
#define __GXX_RTTI 1
#define __pie__ 2
#define __MMX__ 1
#define __FLT_HAS_DENORM__ 1
#define __SIZEOF_LONG_DOUBLE__ 16
#define __BIGGEST_ALIGNMENT__ 16
#define __STDC_UTF_16__ 1
#define __FLT64_MAX_10_EXP__ 308
#define __cpp_delegating_constructors 200604L
#define __FLT32_HAS_INFINITY__ 1
#define __DBL_MAX__ double(1.79769313486231570814527423731704357e+308L)
#define __cpp_raw_strings 200710L
#define __INT_FAST32_MAX__ 0x7fffffffffffffffL
#define __DBL_HAS_INFINITY__ 1
#define __SIZEOF_FLOAT__ 4
#define __HAVE_SPECULATION_SAFE_VALUE 1
#define __cpp_fold_expressions 201603L
#define __DEC32_MIN_EXP__ (-94)
#define __INTPTR_WIDTH__ 64
#define __FLT64X_HAS_INFINITY__ 1
#define __UINT_LEAST32_MAX__ 0xffffffffU
#define __FLT32X_HAS_DENORM__ 1
#define __INT_FAST16_TYPE__ long int
#define __MMX_WITH_SSE__ 1
#define __LDBL_HAS_DENORM__ 1
#define __cplusplus 201703L
#define __cpp_ref_qualifiers 200710L
#define __DEC32_MIN__ 1E-95DF
#define __DEPRECATED 1
#define __cpp_rvalue_references 200610L
#define __DBL_MAX_EXP__ 1024
#define __WCHAR_WIDTH__ 32
#define __FLT32_MAX__ 3.40282346638528859811704183484516925e+38F32
#define __DEC128_EPSILON__ 1E-33DL
#define __SSE2_MATH__ 1
#define __ATOMIC_HLE_RELEASE 131072
#define __PTRDIFF_MAX__ 0x7fffffffffffffffL
#define __amd64 1
#define __ATOMIC_HLE_ACQUIRE 65536
#define __GNUG__ 10
#define __LONG_LONG_MAX__ 0x7fffffffffffffffLL
#define __SIZEOF_SIZE_T__ 8
#define __cpp_nsdmi 200809L
#define __FLT64X_MIN_EXP__ (-16381)
#define __SIZEOF_WINT_T__ 4
#define __LONG_LONG_WIDTH__ 64
#define __cpp_initializer_lists 200806L
#define __cpp_hex_float 201603L
#define __GXX_ABI_VERSION 1014
#define __FLT128_HAS_INFINITY__ 1
#define __FLT_MIN_EXP__ (-125)
#define __GCC_HAVE_DWARF2_CFI_ASM 1
#define __x86_64 1
#define __cpp_lambdas 200907L
#define __INT_FAST64_TYPE__ long int
#define __FLT64_DENORM_MIN__ 4.94065645841246544176568792868221372e-324F64
#define __cpp_template_auto 201606L
#define __DBL_MIN__ double(2.22507385850720138309023271733240406e-308L)
#define __FLT128_EPSILON__ 1.92592994438723585305597794258492732e-34F128
#define __FLT64X_NORM_MAX__ 1.18973149535723176502126385303097021e+4932F64x
#define __SIZEOF_POINTER__ 8
#define __LP64__ 1
#define __DBL_HAS_QUIET_NAN__ 1
#define __FLT32X_EPSILON__ 2.22044604925031308084726333618164062e-16F32x
#define __DECIMAL_BID_FORMAT__ 1
#define __FLT64_MIN_10_EXP__ (-307)
#define __FLT64X_DECIMAL_DIG__ 21
#define __DEC128_MIN__ 1E-6143DL
#define __REGISTER_PREFIX__
#define __UINT16_MAX__ 0xffff
#define __LDBL_HAS_INFINITY__ 1
#define __FLT32_MIN__ 1.17549435082228750796873653722224568e-38F32
#define __UINT8_TYPE__ unsigned char
#define __FLT_DIG__ 6
#define __DEC_EVAL_METHOD__ 2
#define __DEC128_MAX__ 9.999999999999999999999999999999999E6144DL
#define __FLT_MANT_DIG__ 24
#define __LDBL_DECIMAL_DIG__ 21
#define __VERSION__ "10.3.0"
#define __UINT64_C(c) c ## UL
#define __cpp_unicode_characters 201411L
#define _STDC_PREDEF_H 1
#define __INT_LEAST32_MAX__ 0x7fffffff
#define __GCC_ATOMIC_INT_LOCK_FREE 2
#define __FLT128_MAX_EXP__ 16384
#define __FLT32_MANT_DIG__ 24
#define __FLOAT_WORD_ORDER__ __ORDER_LITTLE_ENDIAN__
#define __cpp_aggregate_bases 201603L
#define __FLT128_HAS_DENORM__ 1
#define __FLT32_DECIMAL_DIG__ 9
#define __FLT128_DIG__ 33
#define __INT32_C(c) c
#define __DEC64_EPSILON__ 1E-15DD
#define __ORDER_PDP_ENDIAN__ 3412
#define __DEC128_MIN_EXP__ (-6142)
#define __INT_FAST32_TYPE__ long int
#define __UINT_LEAST16_TYPE__ short unsigned int
#define unix 1
#define __DBL_HAS_DENORM__ 1
#define __cpp_rtti 199711L
#define __SIZE_TYPE__ long unsigned int
#define __UINT64_MAX__ 0xffffffffffffffffUL
#define __FLT64X_DIG__ 18
#define __INT8_TYPE__ signed char
#define __cpp_digit_separators 201309L
#define __ELF__ 1
#define __GCC_ASM_FLAG_OUTPUTS__ 1
#define __UINT32_TYPE__ unsigned int
#define __FLT_RADIX__ 2
#define __INT_LEAST16_TYPE__ short int
#define __LDBL_EPSILON__ 1.08420217248550443400745280086994171e-19L
#define __UINTMAX_C(c) c ## UL
#define __GLIBCXX_BITSIZE_INT_N_0 128
#define __k8 1
#define __FLT32X_MIN__ 2.22507385850720138309023271733240406e-308F32x
#define __SIG_ATOMIC_MAX__ 0x7fffffff
#define __GCC_ATOMIC_WCHAR_T_LOCK_FREE 2
#define __SIZEOF_PTRDIFF_T__ 8
#define __LDBL_DIG__ 18
#define __x86_64__ 1
#define __FLT32X_MIN_EXP__ (-1021)
#define __DEC32_SUBNORMAL_MIN__ 0.000001E-95DF
#define __INT_FAST16_MAX__ 0x7fffffffffffffffL
#define __FLT64_DIG__ 15
#define __UINT_FAST32_MAX__ 0xffffffffffffffffUL
#define __UINT_LEAST64_TYPE__ long unsigned int
#define __FLT_HAS_QUIET_NAN__ 1
#define __FLT_MAX_10_EXP__ 38
#define __LONG_MAX__ 0x7fffffffffffffffL
#define __FLT64X_HAS_DENORM__ 1
#define __DEC128_SUBNORMAL_MIN__ 0.000000000000000000000000000000001E-6143DL
#define __FLT_HAS_INFINITY__ 1
#define __cpp_unicode_literals 200710L
#define __UINT_FAST16_TYPE__ long unsigned int
#define __DEC64_MAX__ 9.999999999999999E384DD
#define __INT_FAST32_WIDTH__ 64
#define __CHAR16_TYPE__ short unsigned int
#define __PRAGMA_REDEFINE_EXTNAME 1
#define __SIZE_WIDTH__ 64
#define __SEG_FS 1
#define __INT_LEAST16_MAX__ 0x7fff
#define __DEC64_MANT_DIG__ 16
#define __INT64_MAX__ 0x7fffffffffffffffL
#define __SEG_GS 1
#define __FLT32_DENORM_MIN__ 1.40129846432481707092372958328991613e-45F32
#define __SIG_ATOMIC_WIDTH__ 32
#define __INT_LEAST64_TYPE__ long int
#define __INT16_TYPE__ short int
#define __INT_LEAST8_TYPE__ signed char
#define __cpp_structured_bindings 201606L
#define __SIZEOF_INT__ 4
#define __DEC32_MAX_EXP__ 97
#define __INT_FAST8_MAX__ 0x7f
#define __FLT128_MAX__ 1.18973149535723176508575932662800702e+4932F128
#define __INTPTR_MAX__ 0x7fffffffffffffffL
#define __cpp_sized_deallocation 201309L
#define __cpp_guaranteed_copy_elision 201606L
#define linux 1
#define __FLT64_HAS_QUIET_NAN__ 1
#define __FLT32_MIN_10_EXP__ (-37)
#define __EXCEPTIONS 1
#define __PTRDIFF_WIDTH__ 64
#define __LDBL_MANT_DIG__ 64
#define __cpp_range_based_for 201603L
#define __FLT64_HAS_INFINITY__ 1
#define __FLT64X_MAX__ 1.18973149535723176502126385303097021e+4932F64x
#define __STDCPP_DEFAULT_NEW_ALIGNMENT__ 16
#define __SIG_ATOMIC_MIN__ (-__SIG_ATOMIC_MAX__ - 1)
#define __code_model_small__ 1
#define __GCC_ATOMIC_LONG_LOCK_FREE 2
#define __cpp_nontype_template_args 201411L
#define __DEC32_MANT_DIG__ 7
#define __cpp_return_type_deduction 201304L
#define __k8__ 1
#define __INTPTR_TYPE__ long int
#define __UINT16_TYPE__ short unsigned int
#define __WCHAR_TYPE__ int
#define __pic__ 2
#define __UINTPTR_MAX__ 0xffffffffffffffffUL
#define __INT_FAST64_WIDTH__ 64
#define __cpp_decltype 200707L
#define __INT_FAST64_MAX__ 0x7fffffffffffffffL
#define __GCC_ATOMIC_TEST_AND_SET_TRUEVAL 1
#define __FLT_NORM_MAX__ 3.40282346638528859811704183484516925e+38F
#define __FLT64X_MAX_EXP__ 16384
#define __UINT_FAST64_TYPE__ long unsigned int
#define __cpp_inline_variables 201606L
#define __INT_MAX__ 0x7fffffff
#define __linux__ 1
#define __INT64_TYPE__ long int
#define __FLT_MAX_EXP__ 128
#define __ORDER_BIG_ENDIAN__ 4321
#define __DBL_MANT_DIG__ 53
#define __cpp_inheriting_constructors 201511L
#define __SIZEOF_FLOAT128__ 16
#define __INT_LEAST64_MAX__ 0x7fffffffffffffffL
#define __DEC64_MIN__ 1E-383DD
#define __WINT_TYPE__ unsigned int
#define __UINT_LEAST32_TYPE__ unsigned int
#define __SIZEOF_SHORT__ 2
#define __FLT32_NORM_MAX__ 3.40282346638528859811704183484516925e+38F32
#define __SSE__ 1
#define __LDBL_MIN_EXP__ (-16381)
#define __FLT64_MAX__ 1.79769313486231570814527423731704357e+308F64
#define __amd64__ 1
#define __WINT_WIDTH__ 32
#define __INT_LEAST8_MAX__ 0x7f
#define __INT_LEAST64_WIDTH__ 64
#define __LDBL_MAX_EXP__ 16384
#define __FLT32X_MAX_10_EXP__ 308
#define __SIZEOF_INT128__ 16
#define __LDBL_MAX_10_EXP__ 4932
#define __ATOMIC_RELAXED 0
#define __DBL_EPSILON__ double(2.22044604925031308084726333618164062e-16L)
#define __FLT128_MIN__ 3.36210314311209350626267781732175260e-4932F128
#define _LP64 1
#define __UINT8_C(c) c
#define __FLT64_MAX_EXP__ 1024
#define __INT_LEAST32_TYPE__ int
#define __SIZEOF_WCHAR_T__ 4
#define __GNUC_PATCHLEVEL__ 0
#define __FLT128_NORM_MAX__ 1.18973149535723176508575932662800702e+4932F128
#define __FLT64_NORM_MAX__ 1.79769313486231570814527423731704357e+308F64
#define __FLT128_HAS_QUIET_NAN__ 1
#define __INTMAX_MAX__ 0x7fffffffffffffffL
#define __INT_FAST8_TYPE__ signed char
#define __cpp_namespace_attributes 201411L
#define __FLT64X_MIN__ 3.36210314311209350626267781732175260e-4932F64x
#define __GNUC_STDC_INLINE__ 1
#define __FLT64_HAS_DENORM__ 1
#define __FLT32_EPSILON__ 1.19209289550781250000000000000000000e-7F32
#define __DBL_DECIMAL_DIG__ 17
#define __STDC_UTF_32__ 1
#define __INT_FAST8_WIDTH__ 8
#define __FXSR__ 1
#define __FLT32X_MAX__ 1.79769313486231570814527423731704357e+308F32x
#define __DBL_NORM_MAX__ double(1.79769313486231570814527423731704357e+308L)
#define __BYTE_ORDER__ __ORDER_LITTLE_ENDIAN__
#define __INTMAX_WIDTH__ 64
#define __cpp_runtime_arrays 198712L
#define __UINT64_TYPE__ long unsigned int
#define __UINT32_C(c) c ## U
#define __cpp_alias_templates 200704L
#define __FLT_DENORM_MIN__ 1.40129846432481707092372958328991613e-45F
#define __INT8_MAX__ 0x7f
#define __LONG_WIDTH__ 64
#define __PIC__ 2
#define __UINT_FAST32_TYPE__ long unsigned int
#define __FLT32X_NORM_MAX__ 1.79769313486231570814527423731704357e+308F32x
#define __CHAR32_TYPE__ unsigned int
#define __FLT_MAX__ 3.40282346638528859811704183484516925e+38F
#define __cpp_constexpr 201603L
#define __SSE2__ 1
#define __cpp_deduction_guides 201703L
#define __INT32_TYPE__ int
#define __SIZEOF_DOUBLE__ 8
#define __cpp_exceptions 199711L
#define __FLT_MIN_10_EXP__ (-37)
#define __FLT64_MIN__ 2.22507385850720138309023271733240406e-308F64
#define __INT_LEAST32_WIDTH__ 32
#define __INTMAX_TYPE__ long int
#define __DEC128_MAX_EXP__ 6145
#define __FLT32X_HAS_QUIET_NAN__ 1
#define __ATOMIC_CONSUME 1
#define __GNUC_MINOR__ 3
#define __GLIBCXX_TYPE_INT_N_0 __int128
#define __INT_FAST16_WIDTH__ 64
#define __UINTMAX_MAX__ 0xffffffffffffffffUL
#define __PIE__ 2
#define __FLT32X_DENORM_MIN__ 4.94065645841246544176568792868221372e-324F32x
#define __cpp_template_template_args 201611L
#define __DBL_MAX_10_EXP__ 308
#define __LDBL_DENORM_MIN__ 3.64519953188247460252840593361941982e-4951L
#define __INT16_C(c) c
#define __STDC__ 1
#define __FLT32X_DIG__ 15
#define __PTRDIFF_TYPE__ long int
#define __ATOMIC_SEQ_CST 5
#define __FLT32X_MIN_10_EXP__ (-307)
#define __UINTPTR_TYPE__ long unsigned int
#define __DEC64_SUBNORMAL_MIN__ 0.000000000000001E-383DD
#define __DEC128_MANT_DIG__ 34
#define __LDBL_MIN_10_EXP__ (-4931)
#define __cpp_generic_lambdas 201304L
#define __SSE_MATH__ 1
#define __SIZEOF_LONG_LONG__ 8
#define __cpp_user_defined_literals 200809L
#define __FLT128_DECIMAL_DIG__ 36
#define __GCC_ATOMIC_LLONG_LOCK_FREE 2
#define __FLT32_HAS_QUIET_NAN__ 1
#define __FLT_DECIMAL_DIG__ 9
#define __UINT_FAST16_MAX__ 0xffffffffffffffffUL
#define __LDBL_NORM_MAX__ 1.18973149535723176502126385303097021e+4932L
#define __GCC_ATOMIC_SHORT_LOCK_FREE 2
#define __UINT_FAST8_TYPE__ unsigned char
#define _GNU_SOURCE 1
#define __cpp_init_captures 201304L
#define __ATOMIC_ACQ_REL 4
#define __ATOMIC_RELEASE 3

6
docs.qrc Normal file
View File

@ -0,0 +1,6 @@
<RCC>
<qresource prefix="/">
<file>docs/HELP.txt</file>
<file>docs/CONFIG.txt</file>
</qresource>
</RCC>

75
docs/CONFIG.txt Normal file
View File

@ -0,0 +1,75 @@
Elements:
db_host
This is the ip address or host name of the database
server the application will attempt to connect to. This
is ignored if using sqlite as the database driver or
any driver that use local file storage.
db_name
This is the name of the database the file system will
attempt to use after connecting to the host. This can be
used to specify the target storage path if using a
driver that uses local file storage.
db_pw
This is the password used to authenticate with the
database if a password is required. Start this value with
a ? if you want this application to obtain the password
from the output of an external command.
Example: ?decrypt_pw
db_uname
This is the authentication username that will be used if
such a thing is required by the database driver. Start
this value with a ? if you want this application to
obtain the username from the output of an external
command.
Example: ?whoami
db_drv
This is the QT based database driver that will be used
when attempting to create a database connection. There
are several database drivers available for QT such as
MySQL, Sqlite, PostgreSQL, and Microsoft ODBC. As of
today, this application only supports MySQL and Sqlite.
use: --list-db-drvs to determine what drivers are
available to use for this parameter.
db_max_bytes
This value is used to report back to the operating
system the maximum amount of bytes that can be stored in
the database. This limit is actively enforced by the file
system. It will honor engineering notation so the byte
size can be written as 5KB, 5MB, 5GB, etc...
mnt_pnt
This is the directory the application will use to mount
the database file system. This directory must already
exist and have at least read+execute permissions to this
directory to successfully mount the database.
mnt_dataset
Forks and snapshots are called datasets and all most
have a unique name for each of them. This parameter
tells the application which dataset to use when mounting
the file system. This application automatically creates
the origin dataset called "root" if it doesn't exists.
The root dataset is considered the main dataset and
cannot be deleted in the same way the forks and snapshots
can. Note: snapshots are read only so if you mount a
snapshot, the filesystem will operate in read only mode.
read_only
This parameter is a bool value that tells the application
to mount the filesystem in read only mode regaurdless if
you're mounting a snapshot dataset or not.

66
docs/HELP.txt Normal file
View File

@ -0,0 +1,66 @@
<Arguments>
--help
Display usage and version information about this application.
--run
Attempt to mount and run the database file system as
configured. This is blocking and is optimized to run via
systemd but can still run without systemd if desired.
--blk-size <numeric-value-in-bytes>
Use this option along --run if initializing the filesystem
for the first time. this parameter will adjust the block
size of the file system. The smaller the blk_size, the
greater the compression effect will take hold; however,
with that comes higher overhead because more hash values
will need to be calculated per file and more blocks per
file read will need to be fetched. This is ignored if a
filesystem already exist in the database, it will instead
use the blk_size value already stored in the database.
If not given, a default value of 16777216 is used.
--config <path-to-json-file>
Use this option to point to a json formatted file to
configure the application's behaviour upon mounting the
database file system. If not present, it will use the
default config file location.
--config-help
Display details about the json config file and the
various elements it uses to change application behaviour.
--list-db-drvs
List all QT based database drivers the application
currently supports. Any value returned by this command
line argument can then be used in "db_drv" inside of the
config file to pick which type of database you desire to
use.
--list-datasets
List all datasets (forks and snapshots) currently in the
database.
--fork <--src name> <--dst name>
This creates a new fork of the given dataset in <src>
with the new name given in <dst>. A fork is basically a
copy of the <src> dataset that is re-writable.
--snapshot <--src name> <--dst name>
This creates a new snapshot of the given dataset in
<src> with the new name given in <dst>. A snapshot is
basically a copy of the <src> dataset that is read-only
--rm-dataset <name>
This removes the given dataset name from the database.
The origin dataset 'root' cannot be removed.

69
docs/README.md Normal file
View File

@ -0,0 +1,69 @@
# DBFS #
(Database Filesystem) DBFS is a FUSE file system utilizing an SQL database as the file system's backend. It mimics regular block storage in database tables, storing hash values of each block and maintains uniqueness among these blocks using those hash vaules. As a result, this file system can theorically store more data while utilizing less actual data storage space. Other benefits include fast/easy snapshotting, forking and indexing.
### Usage ###
```
Usage: dbfs <argument>
Arguments>
--help
Display usage and version information about this application.
--run
Attempt to mount and run the database file system as
configured. This is blocking and is optimized to run via
systemd but can still run without systemd if desired.
--config <path-to-json-file>
Use this option to point to a json formatted file to
configure the application's behaviour upon mounting the
database file system. If not present, it will use the
default config file location.
--config_help
Display details about the json config file and the
various elements it uses to change application behaviour.
--list_db_drvs
List all QT based database drivers the application
currently supports. Any value returned by this command
line argument can then be used in "db_drv" inside of the
config file to pick which type of database you desire to
use.
```
### Build Setup ###
For Linux you need the following packages to successfully build/install:
```
fuse3
libfuse3-3
libfuse3-dev
qtbase5-dev
gcc
make
python3
```
Note: At this time, this application only supports linux based platforms.
### Build ###
To build this project from source you just need to run the build.py and then the install.py python scripts. While running the build the script, it will try to find the Qt API installed in your machine according to the PATH env variable. If not found, it will ask you to input where it can find the Qt bin folder where the qmake executable exists or you can bypass all of this by passing the -qt_dir option on it's command line.
while running the install script, it will ask you to input 1 of 3 options:
***local machine*** - This option will install the built application onto the local machine without creating an installer.
***create installer*** - This option creates an installer that can be distributed to other machines for installation. The resulting installer is just a regular .py script file that the target machine can run if it has Python3 insalled. Only Python3 needs to be installed and an internet connection is not required.
***exit*** - Cancel the installation.
-local or -installer can be passed as command line options for install.py to explicitly select one of the above options without pausing for user input.

348
install.py Normal file
View File

@ -0,0 +1,348 @@
#!/usr/bin/python3
import os
import subprocess
import shutil
import platform
import sys
import zipfile
import binascii
import tempfile
def cd():
current_dir = os.path.dirname(__file__)
if current_dir != "":
os.chdir(current_dir)
def get_default_install_dir(app_target, app_name):
if platform.system() == "Linux":
return "/opt/" + app_target
else:
return "C:\\Program Files\\" + app_name
def get_default_installer_path(app_ver, app_name):
return os.path.expanduser("~") + os.sep + app_name + "-" + app_ver + ".py"
def get_install_dir(app_target, app_name):
path = get_default_install_dir(app_target, app_name)
print("The default install directory is: " + path)
while(True):
ans = input("Do you want to change it? (y/n): ")
if ans == "y" or ans == "Y":
path = input("Enter a new install directory (leave blank to go back to the default): ")
path = os.path.normpath(path)
break
elif ans == "n" or ans == "N":
break
if path == "":
return get_default_install_dir(app_target, app_name)
else:
return path
def get_installer_path(app_ver, app_name):
path = get_default_installer_path(app_ver, app_name)
print("The built .py installer will placed here: " + path)
while(True):
ans = input("Do you want to change the path? (y/n): ")
if ans == "y" or ans == "Y":
path = input("Enter a new path (leave blank to go back to the default): ")
path = os.path.normpath(path)
break
elif ans == "n" or ans == "N":
break
if path == "":
return get_default_installer_path(app_ver, app_name)
else:
return path
def make_install_dir(path):
try:
if not os.path.exists(path):
os.makedirs(path)
return True
except:
print("Failed to create the install directory, please make sure you are runnning this script with admin rights.")
return False
def replace_text(text, old_text, new_text, offs):
while(True):
try:
index = text.index(old_text, offs)
text = text[:index] + new_text + text[index + len(old_text):]
except ValueError:
break
return text
def sub_copy_file(src, dst, old_text, new_text, offs):
print("set: " + dst + " keyword: " + old_text + " to: " + new_text)
text = ""
with open(src, "r") as rd_file:
text = rd_file.read()
text = replace_text(text, old_text, new_text, offs)
with open(dst, "w") as wr_file:
wr_file.write(text)
def template_to_deploy(src, dst, install_dir, app_name, app_target):
sub_copy_file(src, dst, "$install_dir", install_dir, 0)
sub_copy_file(dst, dst, "$app_name", app_name, 0)
sub_copy_file(dst, dst, "$app_target", app_target, 0)
def verbose_copy(src, dst):
print("cpy: " + src + " --> " + dst)
if os.path.isdir(src):
if os.path.exists(dst) and os.path.isdir(dst):
shutil.rmtree(dst)
shutil.copytree(src, dst)
else:
shutil.copyfile(src, dst)
def verbose_create_symmlink(src, dst):
print("lnk: " + src + " --> " + dst)
if os.path.exists(dst):
os.remove(dst)
os.symlink(src, dst)
def conv_utf8_to_utf16(src, dst):
print("cvt: " + dst + " UTF-8 --> UTF-16")
data = bytearray()
with open(src, 'rb') as source_file:
data = source_file.read()
with open(dst, 'w+b') as dest_file:
dest_file.write(data.decode('utf-8').encode('utf-16'))
def local_install(app_target, app_name):
if platform.system() == "Linux":
if not os.path.exists("app_dir/linux"):
print("An app_dir for the Linux platform could not be found.")
else:
install_dir = get_install_dir(app_target, app_name)
if os.path.exists(install_dir + "/uninstall.sh"):
subprocess.run([install_dir + "/uninstall.sh"])
if make_install_dir(install_dir):
template_to_deploy("app_dir/linux/" + app_target + ".sh", install_dir + "/" + app_target + ".sh", install_dir, app_name, app_target)
template_to_deploy("app_dir/linux/uninstall.sh", install_dir + "/uninstall.sh", install_dir, app_name, app_target)
verbose_copy("app_dir/linux/" + app_target, install_dir + "/" + app_target)
verbose_copy("app_dir/linux/lib", install_dir + "/lib")
verbose_copy("app_dir/linux/sqldrivers", install_dir + "/sqldrivers")
verbose_create_symmlink(install_dir + "/" + app_target + ".sh", "/usr/bin/" + app_target)
subprocess.run(["chmod", "-R", "755", install_dir])
print("Installation finished. If you ever need to uninstall this application, run this command with root rights:")
print(" sh " + install_dir + "/uninstall.sh\n")
elif platform.system() == "Windows":
if not os.path.exists("app_dir\\windows"):
print("An app_dir for the Windows platform could not be found.")
else:
install_dir = get_install_dir(app_target, app_name)
if os.path.exists(install_dir + "\\uninstall.bat"):
subprocess.run([install_dir + "\\uninstall.bat"])
if os.path.exists(install_dir):
# this block is here make sure the install_dir is deleted if/when
# the uninstall.bat fails to do so. in my test machine, the .bat
# script will delete install_dir if run directly but not when
# called through subprocess.run() for some reason.
shutil.rmtree(install_dir)
if make_install_dir(install_dir):
verbose_copy("app_dir\\windows", install_dir)
template_to_deploy("app_dir\\windows\\uninstall.bat", install_dir + "\\uninstall.bat", install_dir, app_name, app_target)
print("Installation finished. If you ever need to uninstall this application, run this batch file with admin rights:")
print(" " + install_dir + "\\uninstall.bat\n")
else:
print("The platform you are running in is not compatible.")
print(" output from platform.system() = " + platform.system())
def dir_tree(path):
ret = []
if os.path.isdir(path):
for entry in os.listdir(path):
full_path = os.path.join(path, entry)
if os.path.isdir(full_path):
for sub_dir_file in dir_tree(full_path):
ret.append(sub_dir_file)
else:
ret.append(full_path)
return ret
def to_hex(data):
return str(binascii.hexlify(data))[2:-1]
def from_hex(text_line):
return binascii.unhexlify(text_line)
def make_install(app_ver, app_name):
path = get_installer_path(app_ver, app_name)
with zipfile.ZipFile("app_dir.zip", "w", compression=zipfile.ZIP_DEFLATED) as zip_file:
print("Compressing app_dir --")
for file in dir_tree("app_dir"):
print("adding file: " + file)
zip_file.write(file)
sub_copy_file(__file__, path, "main(is_sfx=False)", "main(is_sfx=True)\n\n\n", 11000)
with open(path, "a") as dst_file, open("app_dir.zip", "rb") as src_file:
print("Packing the compressed app_dir into the sfx script file --")
dst_file.write("# APP_DIR\n")
stat = os.stat("app_dir.zip")
while(True):
buffer = src_file.read(4000000)
if len(buffer) != 0:
dst_file.write("# " + to_hex(buffer) + "\n")
print(str(src_file.tell()) + "/" + str(stat.st_size))
if len(buffer) < 4000000:
break
os.remove("app_dir.zip")
print("Finished.")
def sfx():
abs_sfx_path = os.path.abspath(__file__)
mark_found = False
os.chdir(tempfile.gettempdir())
with open(abs_sfx_path) as packed_file, open("app_dir.zip", "wb") as zip_file:
stat = os.stat(abs_sfx_path)
print("Unpacking the app_dir compressed file from the sfx script.")
while(True):
line = packed_file.readline()
if not line:
break
elif mark_found:
zip_file.write(from_hex(line[2:-1]))
print(str(packed_file.tell()) + "/" + str(stat.st_size))
else:
if line == "# APP_DIR\n":
mark_found = True
print("Done.")
if not mark_found:
print("The app_dir mark was not found, unable to continue.")
else:
with zipfile.ZipFile("app_dir.zip", "r", compression=zipfile.ZIP_DEFLATED) as zip_file:
print("De-compressing app_dir --")
zip_file.extractall()
print("Preparing for installation.")
os.remove("app_dir.zip")
with open("app_dir" + os.sep + "info.txt") as info_file:
list = info_file.read().split("\n")
local_install(list[0], list[2])
shutil.rmtree("app_dir")
def main(is_sfx):
cd()
app_target = ""
app_ver = ""
app_name = ""
if not is_sfx:
with open("app_dir" + os.sep + "info.txt") as info_file:
list = info_file.read().split("\n")
app_target = list[0]
app_ver = list[1]
app_name = list[2]
if is_sfx:
sfx()
elif "-local" in sys.argv:
local_install(app_target, app_name)
elif "-installer" in sys.argv:
make_install(app_ver, app_name)
else:
print("Do you want to install onto this machine or create an installer?")
print("[1] local machine")
print("[2] create installer")
print("[3] exit")
while(True):
opt = input("select an option: ")
if opt == "1":
local_install(app_target, app_name)
break
elif opt == "2":
make_install(app_ver, app_name)
break
elif opt == "3":
break
if __name__ == "__main__":
main(is_sfx=False)

645
src/common.cpp Normal file
View File

@ -0,0 +1,645 @@
#include "common.h"
struct fuse *SharedData::fuseHandle = NULL;
QHash<QString, quint32> *SharedData::inoCache = NULL;
QHash<quint32, Block> *SharedData::hashCache = NULL;
Cleaner *SharedData::fsCleaner = NULL;
QMutex *SharedData::mutex = NULL;
QJsonObject *SharedData::confObj = NULL;
QCoreApplication *SharedData::app = NULL;
QStringList *SharedData::dbConnections = NULL;
QString *SharedData::mntDataset = NULL;
quint64 *SharedData::maxBytes = NULL;
quint64 *SharedData::bytesUsed = NULL;
quint64 *SharedData::blkSize = NULL;
char *SharedData::configPath = NULL;
char *SharedData::mntPnt = NULL;
bool *SharedData::readonly = NULL;
SharedData::SharedData() {}
Path::Path(const QString &fullPath) : info(fullPath) {}
QString Path::dir()
{
return info.path();
}
QString Path::fileName()
{
if (info.isRoot())
{
return QString();
}
else
{
return info.fileName();
}
}
bool Path::root()
{
return info.isRoot();
}
QChar Path::Sep()
{
return QDir::separator();
}
FuseMain::FuseMain(fuse_operations *oper, QObject *parent) : QObject(parent)
{
setupUnixSignalHandlers();
auto *signalHandler = new UnixSignalHandler(SharedData::app);
worker = new QThread();
fs_oper = oper;
connect(signalHandler, &UnixSignalHandler::closeApp, this, &FuseMain::onTerm);
connect(worker, &QThread::started, this, &FuseMain::onStart);
moveToThread(worker);
}
void FuseMain::onTerm()
{
SharedData::app->quit();
}
void FuseMain::onStart()
{
QByteArray appName(APP_NAME);
QByteArray debug("-d");
QByteArray singleTh("-s");
QByteArray foreground("-f");
QByteArray option("-o");
QByteArray dp("default_permissions");
QByteArray ro("ro");
int argc = 7;
struct fuse_args args;
if (*SharedData::readonly)
{
argc += 2;
char *argv[] = {appName.data(),
debug.data(),
singleTh.data(),
foreground.data(),
option.data(),
dp.data(),
option.data(),
ro.data(),
SharedData::mntPnt};
args = FUSE_ARGS_INIT(argc, argv);
}
else
{
char *argv[] = {appName.data(),
debug.data(),
singleTh.data(),
foreground.data(),
option.data(),
dp.data(),
SharedData::mntPnt};
args = FUSE_ARGS_INIT(argc, argv);
}
int ret = fuse_main(args.argc, args.argv, fs_oper, NULL);
if (ret != 0)
{
SharedData::app->exit(ret);
}
}
int FuseMain::loop()
{
worker->start();
return SharedData::app->exec();
}
void dbCleanup()
{
for (auto &conName: *SharedData::dbConnections)
{
QSqlDatabase::removeDatabase(conName);
}
SharedData::dbConnections->clear();
}
void dumpFile(const char *path, QTextStream &strm)
{
QFile file(path);
if (file.open(QFile::ReadOnly))
{
strm << file.readAll();
}
file.close();
}
bool fsFull()
{
return *SharedData::maxBytes <= *SharedData::bytesUsed;
}
bool validDataset(const QString &name)
{
auto ret = true;
const QString forbidden = " %&*()^$#@!`~+=?<>,.[]{}|\\:;\'\"";
for (auto chr : forbidden)
{
if (name.contains(chr))
{
qInfo() << "info: List of forbidden chars (including white spaces) - " << forbidden;
qCritical() << "err: Dataset name contains forbidden char: '" << chr << "'";
ret = false;
}
}
return ret;
}
quint64 toBytes(QString txt)
{
quint64 mod = 1;
if (txt.endsWith("KB", Qt::CaseInsensitive)) mod *= 1000;
if (txt.endsWith("MB", Qt::CaseInsensitive)) mod *= 1000000;
if (txt.endsWith("GB", Qt::CaseInsensitive)) mod *= 1000000000;
if (txt.endsWith("TB", Qt::CaseInsensitive)) mod *= 1000000000000;
if (txt.endsWith("PB", Qt::CaseInsensitive)) mod *= 1000000000000000;
if (txt.endsWith("EB", Qt::CaseInsensitive)) mod *= 1000000000000000000;
if (mod != 1) txt.chop(2);
return txt.trimmed().toDouble() * mod;
}
char *defaultConfig()
{
auto confPath = QDir::homePath().toUtf8() + "/.config/" + QByteArray(APP_TARGET);
auto varPath = QDir::homePath() + "/.var/" + QString(APP_TARGET);
auto mntPath = QDir::homePath() + "/" + QString(APP_NAME);
auto path = confPath + "/config.json";
auto *ret = new char[path.size() + 1];
strcpy(ret, path.data());
if (!QDir(confPath).exists())
{
QDir().mkpath(confPath);
}
if (!QDir(varPath).exists())
{
QDir().mkpath(varPath);
}
if (!QFile::exists(path))
{
QFile file(path);
if (file.open(QFile::WriteOnly))
{
QJsonObject json;
json.insert("db_host", "127.0.0.1");
json.insert("db_name", varPath + "/data.db");
json.insert("db_uname", "?whoami");
json.insert("db_pw", "");
json.insert("db_drv", DBDRV_SQLITE);
json.insert("db_max_bytes", "64GB");
json.insert("mnt_pnt", mntPath);
json.insert("mnt_dataset", ORIGIN_NAME);
json.insert("read_only", false);
file.write(QJsonDocument(json).toJson());
}
file.close();
}
return ret;
}
void addStdErrStr(int errnum)
{
qCritical() << "stderr: " << std::strerror(abs(errnum)) << Qt::endl;
}
bool parseConfig(int &ret)
{
auto res = false;
auto layer2 = false;
QFile file(SharedData::configPath);
if (!file.exists())
{
ret = -ENOENT;
}
else if (!file.open(QFile::ReadOnly))
{
ret = -EIO;
}
else
{
layer2 = true;
auto json = QJsonDocument::fromJson(file.readAll()).object();
auto mntPntBa = json.value("mnt_pnt").toString().toUtf8();
auto dbdrv = json.value("db_drv").toString();
auto maxBytes = toBytes(json.value("db_max_bytes").toString());
auto mntDataset = json.value("mnt_dataset").toString();
auto readonly = json.value("read_only").toBool();
*SharedData::confObj = json;
*SharedData::maxBytes = maxBytes;
*SharedData::mntDataset = mntDataset;
*SharedData::readonly = readonly;
SharedData::mntPnt = new char[mntPntBa.size() + 1];
strcpy(SharedData::mntPnt, mntPntBa.data());
QDir().mkpath(mntPntBa);
qInfo() << "db_driver: " << dbdrv << Qt::endl;
qInfo() << "mnt_pnt: " << *SharedData::mntPnt << Qt::endl;
qInfo() << "mnt_dataset" << *SharedData::mntDataset << Qt::endl;
qInfo() << "capacity(bytes): " << *SharedData::maxBytes << Qt::endl;
qInfo() << "read_only: " << *SharedData::readonly << Qt::endl;
if (!QDir(mntPntBa).exists())
{
ret = -ENOENT;
qCritical() << "err: Reading 'mnt_pnt': " << mntPntBa;
}
else if ((dbdrv != DBDRV_MYSQL) && (dbdrv != DBDRV_SQLITE))
{
ret = -ENOTSUP;
qCritical() << "err: Reading 'db_drv': " << dbdrv;
}
else if (maxBytes <= 0)
{
ret = -EINVAL;
qCritical() << "err: Reading 'db_max_bytes' cannot be less than or equal to 0 or is an invalid format.";
}
else if (mntDataset.isEmpty())
{
ret = -EINVAL;
qCritical() << "err: Reading 'mnt_dataset' cannot be empty.";
}
else
{
res = true;
}
}
file.close();
if ((ret != 0) && (!layer2))
{
qCritical() << "err: Failed to read the config file: " << SharedData::configPath;
}
if (ret != 0)
{
addStdErrStr(ret);
}
return res;
}
void expandDbError(const QSqlError &err, QSqlQuery &query, int &errnum)
{
if (err.text().contains("UNIQUE"))
{
errnum = -EEXIST;
}
else
{
switch (err.type())
{
case QSqlError::ConnectionError: errnum = -EHOSTUNREACH; break;
case QSqlError::StatementError: errnum = -EINVAL; break;
case QSqlError::TransactionError: errnum = -ECANCELED; break;
case QSqlError::UnknownError: errnum = -EBADMSG; break;
case QSqlError::NoError: errnum = -ECANCELED; break;
}
}
expandDbError(err, query);
}
void expandDbError(const QSqlError &err, QSqlQuery &query)
{
qInfo() << "info: last query - " << query.lastQuery();
switch (err.type())
{
case QSqlError::ConnectionError:
{
qCritical() << "err: Database connection error - " << err.text(); break;
}
case QSqlError::StatementError:
{
qCritical() << "err: Database syntax error - " << err.text(); break;
}
case QSqlError::TransactionError:
{
qCritical() << "err: Database transaction error - " << err.text(); break;
}
case QSqlError::UnknownError:
{
qCritical() << "err: Database unknown erorr - " << err.text(); break;
}
case QSqlError::NoError:
{
qCritical() << "err: Database claims no error occured but the last transaction was unsuccessful"; break;
}
}
}
void expandDbError(const QSqlError &err, int &errnum)
{
auto query = QSqlQuery("none");
expandDbError(err, query, errnum);
}
QStringList parseArgs(const QString &line, int maxArgs)
{
QStringList ret;
QString arg;
auto inDQuotes = false;
auto inSQuotes = false;
auto escaped = false;
for (int i = 0; i < line.size(); ++i)
{
if ((line[i] == '\'') && !inDQuotes && !escaped)
{
// single quote '
inSQuotes = !inSQuotes;
}
else if ((line[i] == '\"') && !inSQuotes && !escaped)
{
// double quote "
inDQuotes = !inDQuotes;
}
else
{
escaped = false;
if (line[i].isSpace() && !inDQuotes && !inSQuotes)
{
// space
if (!arg.isEmpty())
{
ret.append(arg);
arg.clear();
}
}
else
{
if ((line[i] == '\\') && ((i + 1) < line.size()))
{
if ((line[i + 1] == '\'') || (line[i + 1] == '\"'))
{
escaped = true;
}
else
{
arg.append(line[i]);
}
}
else
{
arg.append(line[i]);
}
}
}
if ((ret.size() >= maxArgs) && (maxArgs != -1))
{
break;
}
}
if (!arg.isEmpty() && !inDQuotes && !inSQuotes)
{
ret.append(arg);
}
return ret;
}
QString escapeChars(const QString &str, const QChar &escapeChr, const QChar &chr)
{
QString ret;
bool escaped = false;
if (escapeChr == chr)
{
ret = str;
}
else
{
for (auto&& strChr : str)
{
if ((strChr == chr) && !escaped)
{
ret.append(escapeChr);
ret.append(strChr);
}
else
{
escaped = false;
if (strChr == escapeChr)
{
escaped = true;
}
ret.append(strChr);
}
}
}
return ret;
}
QString escapeChars(const QString &str, const QChar &escapeChr, const QString &chrs)
{
auto ret = str;
for (auto chr: chrs)
{
ret = escapeChars(ret, escapeChr, chr);
}
return ret;
}
mode_t fileDefaultMode()
{
return S_IRUSR | S_IWUSR | S_IRGRP | S_IROTH | S_IFREG;
}
mode_t symmDefaultMode()
{
return S_IRUSR | S_IWUSR | S_IRGRP | S_IROTH | S_IFLNK;
}
mode_t dirDefaultMode()
{
return S_IRWXU | S_IRGRP | S_IXGRP | S_IROTH | S_IXOTH | S_IFDIR;
}
QString extExpand(const QString &text, int &retCode)
{
if (text.startsWith("?", Qt::CaseInsensitive) && (retCode == 0))
{
QString res;
QProcess proc;
auto args = parseArgs(text.mid(1), -1);
if (args.isEmpty())
{
qCritical() << "err: External command failure: no actual command was called - empty arguments." << Qt::endl;
retCode = -EINVAL;
}
else
{
proc.setProgram(args[0].trimmed());
proc.setArguments(args.mid(1));
proc.start();
proc.waitForFinished(-1);
if (proc.exitCode() != 0)
{
qCritical() << "err: External command failure: exit code - " << proc.exitCode() << " msg - " << proc.readAllStandardError() << Qt::endl;
retCode = -ECANCELED;
}
else
{
res = proc.readAllStandardOutput();
}
}
return res.trimmed();
}
else
{
return text.trimmed();
}
}
void calcBlkOffsAndPos(quint64 dataOffs, int &firstBlkOffs, int &blkNum)
{
blkNum = dataOffs / *SharedData::blkSize;
firstBlkOffs = *SharedData::blkSize - (((blkNum + 1) * *SharedData::blkSize) - dataOffs);
}
int calcNumOfBlocks(quint64 len, bool countZero)
{
if ((len == 0) && !countZero)
{
return 0;
}
if (len == 0)
{
return 1;
}
else
{
qreal blks = static_cast<qreal>(len) / static_cast<qreal>(*SharedData::blkSize);
return static_cast<int>(ceil(blks));
}
}
quint64 calcSizeOfLastBlk(quint64 len)
{
return (calcNumOfBlocks(len) * *SharedData::blkSize) - len;
}
quint64 calcDiff(quint64 numA, quint64 numB)
{
if (numA > numB) return numA - numB;
if (numB > numA) return numB - numA;
return 0;
}
bool isDDir(const QString &path)
{
return path.startsWith(D_DIR);
}
QString genInstanceName()
{
auto thrId = std::this_thread::get_id();
std::stringstream ss;
ss << thrId;
std::string thrStr = ss.str();
return QString(APP_TARGET) + "-" + QString::number(getpid()) + "-" + QString::fromStdString(thrStr);
}
quint32 genSerial()
{
quint64 unique1 = QDateTime::currentDateTimeUtc().toMSecsSinceEpoch() + 1;
quint64 unique2 = QDateTime::currentDateTimeUtc().toMSecsSinceEpoch() + 2;
char *frontBytes = reinterpret_cast<char*>(&unique1);
char *backBytes = reinterpret_cast<char*>(&unique2);
quint32 front = qChecksum(QByteArray::fromRawData(frontBytes, 8));
quint32 back = qChecksum(QByteArray::fromRawData(backBytes, 8));
return (front << 16) | back;
}
QByteArray genHash(const char *bytes, quint64 len)
{
QCryptographicHash hasher(QCryptographicHash::Sha1);
hasher.addData(bytes, len);
return hasher.result();
}
QByteArray genHash(const QByteArray &bytes)
{
return genHash(bytes.data(), bytes.size());
}

190
src/common.h Normal file
View File

@ -0,0 +1,190 @@
#ifndef COMMON_H
#define COMMON_H
#define FUSE_USE_VERSION 31
#define HASH_SIZE 20
#define PATH_SIZE 255
#define CLEANER_DELAY 1000
#define DEFAULT_BLK_SIZE 16777216
#define APP_NAME "DBFS"
#define APP_VER "1.0"
#define APP_TARGET "dbfs"
#define D_DIR "/.d"
#define SNAP_DIR "/.d/snapshots/"
#define FORK_DIR "/.d/forks/"
#define TMP_DIR "/.d/tmp"
#define SNAPSHOT_P_INDEX "fsPSIndex_"
#define SNAPSHOT_H_INDEX "fsHSIndex_"
#define FORK_P_INDEX "fsPFIndex_"
#define FORK_H_INDEX "fsHFIndex_"
#define ORIGIN_P_INDEX "fsPOIndex_root"
#define ORIGIN_H_INDEX "fsHOIndex_root"
#define ORIGIN_NAME "root"
#define DBDRV_SQLITE "QSQLITE"
#define DBDRV_MYSQL "QMYSQL"
#include <QCoreApplication>
#include <QRegularExpression>
#include <QTextStream>
#include <QThread>
#include <QFile>
#include <QSqlDatabase>
#include <QJsonObject>
#include <QJsonDocument>
#include <QDir>
#include <QSqlError>
#include <QSqlQuery>
#include <QProcess>
#include <QStringList>
#include <QDateTime>
#include <QFileInfo>
#include <QCryptographicHash>
#include <QMutex>
#include <QHash>
#include <QDebug>
#include <QTimer>
#include <fuse3/fuse.h>
#include <fuse3/fuse_lowlevel.h>
#include <fuse3/fuse_common.h>
#include <errno.h>
#include <cstring>
#include <unistd.h>
#include <thread>
#include <sstream>
#include <string>
#include <limits>
#include <tgmath.h>
#include <time.h>
#include <sys/types.h>
#include "unix_signal.h"
enum PathOp
{
READ_ONLY = 1,
READ_WRITE = 1 << 1,
NO_DIR = 1 << 2,
DIR_ONLY = 1 << 3
};
enum DataSetTypes
{
SNAPSHOT,
FORK,
ORIGIN
};
enum TableTypes
{
P_TABLE,
H_TABLE
};
QString genInstanceName();
QString escapeChars(const QString &str, const QChar &escapeChr, const QChar &chr);
QString escapeChars(const QString &str, const QChar &escapeChr, const QString &chrs);
QStringList parseArgs(const QString &line, int maxArgs);
QByteArray genHash(const QByteArray &bytes);
QByteArray genHash(const char *bytes, quint64 len);
QString extExpand(const QString &text, int &retCode);
QString dbDrvr();
quint64 toBytes(QString txt);
quint32 genSerial();
mode_t fileDefaultMode();
mode_t symmDefaultMode();
mode_t dirDefaultMode();
bool isDDir(const QString &path);
bool validPath(const QString &path);
bool validDataset(const QString &name);
bool parseConfig(int &ret);
bool fsFull();
char *defaultConfig();
void dbCleanup();
void dumpFile(const char *path, QTextStream &strm);
void addStdErrStr(int errnum);
void expandDbError(const QSqlError &err, QSqlQuery &query);
void expandDbError(const QSqlError &err, QSqlQuery &query, int &errnum);
void expandDbError(const QSqlError &err, int &errnum);
void calcBlkOffsAndPos(quint64 dataOffs, int &firstBlkOffs, int &blkNum);
int calcNumOfBlocks(quint64 len, bool countZero = true);
quint64 calcSizeOfLastBlk(quint64 len);
quint64 calcDiff(quint64 numA, quint64 numB);
struct Block
{
QByteArray blk;
QString dataset;
quint32 ino;
int blkNum;
bool update;
};
class Cleaner;
class SharedData
{
public:
static struct fuse *fuseHandle;
static QHash<quint32, Block> *hashCache;
static QHash<QString, quint32> *inoCache;
static Cleaner *fsCleaner;
static QMutex *mutex;
static QJsonObject *confObj;
static QCoreApplication *app;
static QStringList *dbConnections;
static QString *mntDataset;
static quint64 *maxBytes;
static quint64 *bytesUsed;
static quint64 *blkSize;
static char *configPath;
static char *mntPnt;
static bool *readonly;
explicit SharedData();
};
class Path
{
private:
QFileInfo info;
public:
static QChar Sep();
explicit Path(const QString &fullPath);
QString dir();
QString fileName();
bool root();
};
class FuseMain : public QObject
{
Q_OBJECT
private:
QThread *worker;
struct fuse_operations *fs_oper;
private slots:
void onStart();
public slots:
void onTerm();
int loop();
public:
explicit FuseMain(struct fuse_operations *oper, QObject *parent = NULL);
};
#endif // COMMON_H

1249
src/db.cpp Normal file
View File

File diff suppressed because it is too large Load Diff

81
src/db.h Normal file
View File

@ -0,0 +1,81 @@
#ifndef DB_H
#define DB_H
#include "common.h"
QString getHsTable(const QString &snapShot);
QString getHfTable(const QString &fork);
QString getPsTable(const QString &snapShot);
QString getPfTable(const QString &fork);
QString getPTable(const QString &datasetName, const QSqlDatabase &dbObj);
QString getHTable(const QString &datasetName, const QSqlDatabase &dbObj);
QString getDataset(const QString &path);
QStringList getAllHTables();
QStringList getAllPTables();
QStringList getAllFSTables(const char *sSig, const char *fSig);
QSqlDatabase getDbObj(int &retCode);
quint32 getIno(const QString &path);
void getAllDatasetNames(const char *pSig, const char *hSig, QHash<QString, uint> &list, uint modes);
void getAllSnapShots(QHash<QString, uint> &list);
void getAllForks(QHash<QString, uint> &list);
int getMode(const QString &path, const QString &dataset, const QSqlDatabase &dbObj);
int getMode(QString path);
int countRows(QSqlQuery &query);
bool delDataset(const QString &name, int &retCode);
bool cpyDataset(const QString &src, const QString &dst, int &retCode);
bool updateIndex(quint32 ino, const QString &dataset, int &retCode);
bool flushHashCache(quint32 ino, int &retCode);
bool flushHashCache(const Block &cache, int &retCode);
bool procHashCache(Block &cache, const char *buff, quint64 &dataLen, bool &overFlow, int &retCode);
bool dbExec(QSqlQuery &query, int &retCode, bool init = true);
bool dbExec(QSqlQuery &query, const QString &qstr, int &retCode, bool init = false);
bool checkPath(QString &path, const QSqlDatabase &dbObj, QString &dataset, int pathop, int &retCode);
bool verifySnapshot(const QString &snapShot, int &retCode);
bool createDataset(const QString &name, const QSqlDatabase &dbObj, DataSetTypes type, int &retCode);
bool dataSetExists(const QString &name, const QSqlDatabase &dbObj);
bool tableExists(const QString &table, const QSqlDatabase &dbObj);
bool addBlk(const QByteArray &hash, const QByteArray &blk, int &retCode);
bool isDir(int mode);
bool isSym(int mode);
bool isSnapshot(const QString &name);
bool isFork(const QString &name);
bool createFile(const QString &path, mode_t mode, const QByteArray &data, int &retCode);
bool createRoot(const QString &pTable, QSqlQuery &query, int &retCode);
bool createDir(const QString &path, mode_t mode, int &retCode);
bool removeItem(const QString &path, int &retCode);
bool rePath(const QString &oldPath, const QString &newPath, int &retCode);
bool deepCpy(const QString &src, const QString &dst, const QSqlDatabase &dbObj, const QString &srcDataset, const QString &dstDataset, int &retCode);
bool truncateBlks(const QString &path, quint64 oldSize, quint64 newSize, int &retCode);
bool allocate(const QString &path, quint64 currentSize, quint64 offs, quint64 len, int &retCode);
bool getBlkData(const QString &path, char *buff, quint64 dataOffs, quint64 dataLen, int &retCode);
bool setBlkData(const QString &path, const char *buff, quint64 dataOffs, quint64 dataLen, int &retCode);
bool setHash(quint32 ino, bool exists, int blkNum, const QByteArray &newHash, const QString &dataset, const QSqlDatabase &dbObj, int &retCode);
bool getDirQuery(QString path, QSqlQuery &query, int &retCode);
bool getIndexQuery(const QString &path, QSqlQuery &query, int &retCode);
bool checkVersion(int &retCode);
bool dbSetup(int &retCode);
class Cleaner : public QObject
{
Q_OBJECT
private:
bool firstRun;
QList<quint32> inoQueue;
QList<quint64> mtQueue;
QList<QString> dsQueue;
QTimer *timer;
private slots:
void exeGarbageCollect();
public:
void garbageCollect();
explicit Cleaner(QObject *parent = nullptr);
};
#endif // DB_H

522
src/fuse_func.cpp Normal file
View File

@ -0,0 +1,522 @@
#include "fuse_func.h"
int fs_getattr(const char *path, struct stat *info, struct fuse_file_info *fi)
{
Q_UNUSED(fi);
QSqlQuery query;
auto ret = 0;
memset(info, 0, sizeof(struct stat));
info->st_uid = getuid();
info->st_gid = getgid();
info->st_nlink = 1;
info->st_blksize = *SharedData::blkSize;
auto curr = QDateTime::currentDateTime();
info->st_atim.tv_nsec = curr.toMSecsSinceEpoch();
info->st_atim.tv_sec = curr.toSecsSinceEpoch();
const QString ddir = QDir::cleanPath(D_DIR);
const QString fdir = QDir::cleanPath(FORK_DIR);
const QString sdir = QDir::cleanPath(SNAP_DIR);
if ((ddir == path) || (fdir == path) || (sdir == path))
{
info->st_mode = dirDefaultMode();
info->st_ino = 1;
info->st_size = 0;
info->st_blocks = 0;
info->st_ctime = info->st_atime;
info->st_mtime = info->st_atime;
if (sdir == path)
{
info->st_mode ^= S_IWUSR;
}
}
else if (getIndexQuery(path, query, ret))
{
info->st_ino = query.value("ino").toULongLong();
info->st_mode = query.value("mode").toUInt();
info->st_size = query.value("size").toULongLong();
info->st_blocks = calcNumOfBlocks(info->st_size);
// this converts the UTC epoch stored in the db to
// local epoch using QDateTime.
auto cTime = QDateTime::fromMSecsSinceEpoch(query.value("c_time").toULongLong(), Qt::LocalTime);
auto mTime = QDateTime::fromMSecsSinceEpoch(query.value("m_time").toULongLong(), Qt::LocalTime);
info->st_ctim.tv_sec = cTime.toSecsSinceEpoch();
info->st_mtim.tv_sec = mTime.toSecsSinceEpoch();
info->st_ctim.tv_nsec = cTime.toMSecsSinceEpoch();
info->st_mtim.tv_nsec = cTime.toMSecsSinceEpoch();
}
return ret;
}
int fs_readlink(const char *path, char *buff, size_t len)
{
auto ret = 0;
if (getBlkData(path, buff, 0, len, ret))
{
return 0;
}
else
{
return ret;
}
}
int fs_readdir(const char *path, void *buff, fuse_fill_dir_t filler, off_t offset, struct fuse_file_info *fi, enum fuse_readdir_flags flags)
{
Q_UNUSED(offset);
Q_UNUSED(fi);
Q_UNUSED(flags);
QSqlQuery query;
struct stat st;
memset(&st, 0, sizeof(st));
auto ret = 0;
auto specialList = QHash<QString, uint>();
if (QDir::cleanPath(path) == QDir::cleanPath(SNAP_DIR))
{
getAllSnapShots(specialList);
}
else if (QDir::cleanPath(path) == QDir::cleanPath(FORK_DIR))
{
getAllForks(specialList);
}
else if (QDir::cleanPath(path) == QDir::cleanPath(D_DIR))
{
specialList.insert(Path(QDir::cleanPath(SNAP_DIR)).fileName(), dirDefaultMode() ^ S_IWUSR);
specialList.insert(Path(QDir::cleanPath(FORK_DIR)).fileName(), dirDefaultMode());
}
if (!specialList.isEmpty())
{
for (auto &item : specialList.keys())
{
st.st_mode = specialList[item];
if (filler(buff, item.toUtf8().data(), &st, 0, FUSE_FILL_DIR_PLUS))
{
ret = -ENOMEM;
}
}
}
else if (getDirQuery(path, query, ret))
{
if (Path(path).root())
{
st.st_mode = dirDefaultMode();
if (filler(buff, QByteArray(D_DIR).mid(1).data(), &st, 0, FUSE_FILL_DIR_PLUS))
{
ret = -ENOMEM;
}
}
while (query.next() && ret == 0)
{
st.st_mode = query.value("mode").toUInt();
auto filename = query.value("file_name").toByteArray();
if (!filename.isEmpty())
{
if (filler(buff, filename.data(), &st, 0, FUSE_FILL_DIR_PLUS))
{
ret = -ENOMEM;
}
}
}
}
return ret;
}
int fs_mkdir(const char *path, mode_t mode)
{
Q_UNUSED(mode);
auto ret = 0;
createDir(path, dirDefaultMode(), ret);
return ret;
}
int fs_symlink(const char *src, const char *dst)
{
auto ret = 0;
if (fsFull())
{
ret = -EDQUOT;
}
if (getMode(src) == 0)
{
ret = -ENOENT;
}
else
{
createFile(dst, symmDefaultMode(), QByteArray::fromRawData(src, strlen(src) + 1), ret);
}
return ret;
}
int countRows(QSqlQuery &query)
{
auto ret = 0;
while(query.next()) ret++;
query.first();
return ret;
}
int fs_unlink(const char *path)
{
auto ret = 0;
if (isDDir(path))
{
ret = -EPERM;
}
else
{
removeItem(path, ret);
}
return ret;
}
int fs_rmdir(const char *path)
{
QSqlQuery query;
auto ret = 0;
if (getDirQuery(path, query, ret))
{
if (countRows(query) > 1)
{
ret = -ENOTEMPTY;
}
else
{
removeItem(path, ret);
}
}
return ret;
}
int fs_rename(const char *src, const char *dst, unsigned int flags)
{
auto ret = 0;
auto srcMode = getMode(src);
auto dstMode = getMode(dst);
if (srcMode && dstMode)
{
if (srcMode != dstMode)
{
ret = -EINVAL;
}
else if (flags & RENAME_EXCHANGE)
{
auto tmp = QString(TMP_DIR) + QString(src);
if (ret == 0) rePath(src, tmp, ret);
if (ret == 0) rePath(dst, src, ret);
if (ret == 0) rePath(tmp, dst, ret);
}
else if ((flags & RENAME_NOREPLACE) == 0)
{
rePath(src, dst, ret);
}
else
{
ret = -EEXIST;
}
}
else if (srcMode && !dstMode)
{
rePath(src, dst, ret);
}
else
{
ret = -ENOENT;
}
return ret;
}
int fs_truncate(const char *path, off_t size, struct fuse_file_info *fi)
{
Q_UNUSED(fi);
QSqlQuery query;
auto ret = 0;
if (getIndexQuery(path, query, ret))
{
truncateBlks(path, query.value("size").toULongLong(), size, ret);
}
return ret;
}
int fs_open(const char *path, struct fuse_file_info *fi)
{
auto ret = 0;
auto dbObj = getDbObj(ret);
auto pathCpy = QString(path);
QString dataset;
if (ret == 0)
{
if (fi->flags & (O_WRONLY | O_RDWR | O_APPEND))
{
checkPath(pathCpy, dbObj, dataset, READ_WRITE | NO_DIR, ret);
}
else
{
checkPath(pathCpy, dbObj, dataset, READ_ONLY | NO_DIR, ret);
}
}
return ret;
}
int fs_create(const char *path, mode_t mode, struct fuse_file_info *fi)
{
auto ret = 0;
if (getMode(path))
{
return fs_open(path, fi);
}
else if (fsFull())
{
ret = -EDQUOT;
}
else
{
createFile(path, mode, QByteArray(), ret);
if (ret == 0)
{
return fs_open(path, fi);
}
}
return ret;
}
int fs_read(const char *path, char *buff, size_t len, off_t offs, struct fuse_file_info *fi)
{
Q_UNUSED(fi);
auto ret = 0;
getBlkData(path, buff, offs, len, ret);
return ret;
}
int fs_write(const char *path, const char *buff, size_t len, off_t offs, struct fuse_file_info *fi)
{
Q_UNUSED(fi);
auto ret = 0;
for (; (len > 0) && (ret == 0); len -= *SharedData::blkSize)
{
if (len > *SharedData::blkSize)
{
setBlkData(path, buff, offs, *SharedData::blkSize, ret);
}
else
{
setBlkData(path, buff, offs, len, ret);
}
}
return ret;
}
int fs_statfs(const char *path, struct statvfs *stbuff)
{
Q_UNUSED(path);
auto ret = 0;
auto query = QSqlQuery(getDbObj(ret));
if (ret == 0)
{
stbuff->f_frsize = *SharedData::blkSize;
stbuff->f_bsize = *SharedData::blkSize;
stbuff->f_blocks = calcNumOfBlocks(*SharedData::maxBytes);
stbuff->f_bfree = stbuff->f_blocks - calcNumOfBlocks(*SharedData::bytesUsed, false);
stbuff->f_bavail = stbuff->f_bfree;
const QString selectTableStr = "SELECT COUNT(ino) AS num_of_files FROM %1 WHERE (mode & :bind1) <> :bind2";
QString fullSelect;
auto tables = getAllPTables();
for (int i = 0; i < tables.size(); ++i)
{
fullSelect.append(selectTableStr.arg(tables[i]));
if ((i + 1) < tables.size())
{
fullSelect.append(" UNION ALL ");
}
}
query.prepare(fullSelect);
query.bindValue(":bind1", S_IFMT);
query.bindValue(":bind2", S_IFDIR);
if (dbExec(query, ret))
{
stbuff->f_files = std::numeric_limits<unsigned long>::max();
stbuff->f_namemax = 65535;
for (stbuff->f_ffree = stbuff->f_files; query.next();)
{
stbuff->f_ffree -= query.value("num_of_files").toULongLong();
}
}
}
return 0;
}
void fs_destroy(void *privateData)
{
Q_UNUSED(privateData);
dbCleanup();
SharedData::app->quit();
}
int fs_utimens(const char *path, const struct timespec newTimes[2], struct fuse_file_info *fi)
{
Q_UNUSED(fi);
Q_UNUSED(newTimes);
auto ret = 0;
auto dbObj = getDbObj(ret);
auto pathCpy = QString(path);
QString dataset;
if ((ret == 0) && checkPath(pathCpy, dbObj, dataset, READ_WRITE, ret))
{
auto query = QSqlQuery(dbObj);
auto info = Path(pathCpy);
auto nowUTC = QDateTime::currentDateTimeUtc().toMSecsSinceEpoch();
query.prepare("UPDATE " + getPTable(dataset, dbObj) + " SET m_time = :bind1 WHERE dir = :bind2 AND file_name = :bind3;");
query.bindValue(":bind1", nowUTC);
query.bindValue(":bind2", info.dir());
query.bindValue(":bind3", info.fileName());
dbExec(query, ret);
}
return ret;
}
int fs_fallocate(const char *path, int mode, off_t offs, off_t len, struct fuse_file_info *fi)
{
Q_UNUSED(fi);
Q_UNUSED(mode);
QSqlQuery query;
auto ret = 0;
if (getIndexQuery(path, query, ret))
{
allocate(path, query.value("size").toULongLong(), offs, len, ret);
}
return ret;
}
int fs_flush(const char *path, struct fuse_file_info *fi)
{
Q_UNUSED(fi);
auto ino = getIno(path);
auto ret = 0;
if (SharedData::hashCache->contains(ino))
{
if (flushHashCache(ino, ret))
{
auto dataset = SharedData::hashCache->value(ino).dataset;
SharedData::hashCache->remove(ino);
updateIndex(ino, dataset, ret);
}
}
return ret;
}
int fs_release(const char *path, struct fuse_file_info *fi)
{
return fs_flush(path, fi);
}
int fs_chmod(const char *path, mode_t mode, struct fuse_file_info *fi)
{
Q_UNUSED(path);
Q_UNUSED(mode);
Q_UNUSED(fi);
return 0;
}
int fs_chown(const char *path, uid_t uid, gid_t gid, struct fuse_file_info *fi)
{
Q_UNUSED(path);
Q_UNUSED(uid);
Q_UNUSED(gid);
Q_UNUSED(fi);
return 0;
}
void *fs_init(struct fuse_conn_info *conn, struct fuse_config *cfg)
{
Q_UNUSED(conn);
Q_UNUSED(cfg);
return NULL;
}

30
src/fuse_func.h Normal file
View File

@ -0,0 +1,30 @@
#ifndef FUSE_FUNC_H
#define FUSE_FUNC_H
#include "common.h"
#include "db.h"
int fs_getattr(const char *path, struct stat *info, struct fuse_file_info *fi);
int fs_readlink(const char *path, char *buff, size_t len);
int fs_readdir(const char *path, void *buff, fuse_fill_dir_t filler, off_t offset, struct fuse_file_info *fi, enum fuse_readdir_flags flags);
int fs_mkdir(const char *path, mode_t mode);
int fs_symlink(const char *src, const char *dst);
int fs_unlink(const char *path);
int fs_rmdir(const char *path);
int fs_chmod(const char *path, mode_t mode, struct fuse_file_info *fi);
int fs_chown(const char *path, uid_t uid, gid_t gid, struct fuse_file_info *fi);
int fs_flush(const char *path, struct fuse_file_info *fi);
int fs_release(const char *path, struct fuse_file_info *fi);
int fs_rename(const char *src, const char *dst, unsigned int flags);
int fs_truncate(const char *path, off_t size, struct fuse_file_info *fi);
int fs_open(const char *path, struct fuse_file_info *fi);
int fs_create(const char *path, mode_t mode, struct fuse_file_info *fi);
int fs_read(const char *path, char *buff, size_t len, off_t offs, struct fuse_file_info *fi);
int fs_write(const char *path, const char *buff, size_t len, off_t offs, struct fuse_file_info *fi);
int fs_statfs(const char *path, struct statvfs *stbuff);
int fs_utimens(const char *path, const struct timespec newTimes[2], struct fuse_file_info *fi);
int fs_fallocate(const char *path, int mode, off_t offs, off_t len, struct fuse_file_info *fi);
void *fs_init(struct fuse_conn_info *conn, struct fuse_config *cfg);
void fs_destroy(void *privateData);
#endif // FUSE_FUNC_H

327
src/main.cpp Normal file
View File

@ -0,0 +1,327 @@
#include "common.h"
#include "fuse_func.h"
#include "db.h"
int showHelp()
{
QTextStream strm(stdout);
strm << "" << Qt::endl;
strm << APP_NAME << " " << APP_VER << Qt::endl << Qt::endl;
strm << "Usage: " << APP_TARGET << " <argument>" << Qt::endl << Qt::endl;
dumpFile(":/docs/HELP.txt", strm);
return 0;
}
int showConfigHelp()
{
QTextStream strm(stdout);
dumpFile(":/docs/CONFIG.txt", strm);
return 0;
}
int lsDbDrvs()
{
QTextStream strm(stdout);
strm << "" << Qt::endl;
for (const auto &driver : QSqlDatabase::drivers())
{
if ((driver == DBDRV_MYSQL) || (driver == DBDRV_SQLITE))
{
strm << driver << Qt::endl;
}
}
strm << "" << Qt::endl;
return 0;
}
int lsDatasets()
{
QHash<QString, uint> forks;
QHash<QString, uint> snapshots;
getAllForks(forks);
getAllSnapShots(snapshots);
QTextStream textOut(stdout);
textOut << "Origin:" << Qt::endl << ORIGIN_NAME << Qt::endl;
textOut << "Forks:" << Qt::endl;
for (auto name : forks.keys())
{
textOut << name << " ";
}
textOut << "Snapshots:" << Qt::endl;
for (auto name : snapshots.keys())
{
textOut << name << " ";
}
return 0;
}
int createFork(const QString &src, const QString &dst, const QSqlDatabase &dbObj, int &retCode)
{
if (createDataset(dst, dbObj, FORK, retCode))
{
cpyDataset(src, dst, retCode);
}
return retCode;
}
int createSnapshot(const QString &src, const QString &dst, const QSqlDatabase &dbObj, int &retCode)
{
if (createDataset(dst, dbObj, SNAPSHOT, retCode))
{
cpyDataset(src, dst, retCode);
}
return retCode;
}
int rmDataset(const QString &name)
{
auto retCode = 0;
auto dbObj = getDbObj(retCode);
if (retCode == 0)
{
if (!dataSetExists(name, dbObj))
{
QTextStream(stderr) << "err: Dataset '" << name << "' not found." << Qt::endl; return -ENOENT;
}
else if (name == ORIGIN_NAME)
{
QTextStream(stderr) << "err: Cannot delete origin dataset '" << name << "'" << Qt::endl; return -EPERM;
}
else if (!validDataset(name))
{
QTextStream(stderr) << "err: Invalid dataset name '" << name << "'" << Qt::endl; return -EINVAL;
}
else
{
delDataset(name, retCode);
}
}
return retCode;
}
int runApp(QCoreApplication *app)
{
auto ret = 0;
quint64 maxBytes = 0;
quint64 usedBytes = 0;
QHash<QString, quint32> inoCache;
QHash<quint32, Block> hashCache;
Cleaner fsCleaner;
QStringList dbConnections;
QString mntDataset;
QJsonObject confObj;
QMutex mutex;
bool rdOnly;
SharedData::app = app;
SharedData::confObj = &confObj;
SharedData::dbConnections = &dbConnections;
SharedData::maxBytes = &maxBytes;
SharedData::bytesUsed = &usedBytes;
SharedData::inoCache = &inoCache;
SharedData::hashCache = &hashCache;
SharedData::fsCleaner = &fsCleaner;
SharedData::mntDataset = &mntDataset;
SharedData::readonly = &rdOnly;
SharedData::mutex = &mutex;
if (parseConfig(ret) && dbSetup(ret))
{
struct fuse_operations fs_oper;
fs_oper.getattr = fs_getattr;
fs_oper.readlink = fs_readlink;
fs_oper.readdir = fs_readdir;
fs_oper.mkdir = fs_mkdir;
fs_oper.symlink = fs_symlink;
fs_oper.unlink = fs_unlink;
fs_oper.rmdir = fs_rmdir;
fs_oper.rename = fs_rename;
fs_oper.truncate = fs_truncate;
fs_oper.open = fs_open;
fs_oper.create = fs_create;
fs_oper.read = fs_read;
fs_oper.write = fs_write;
fs_oper.statfs = fs_statfs;
fs_oper.init = fs_init;
fs_oper.destroy = fs_destroy;
fs_oper.utimens = fs_utimens;
fs_oper.fallocate = fs_fallocate;
fs_oper.flush = fs_flush;
fs_oper.release = fs_release;
fs_oper.chmod = fs_chmod;
fs_oper.chown = fs_chown;
fs_oper.copy_file_range = NULL;
fs_oper.link = NULL;
fs_oper.lock = NULL;
fs_oper.releasedir = NULL;
fs_oper.fsync = NULL;
fs_oper.opendir = NULL;
fs_oper.fsyncdir = NULL;
fs_oper.bmap = NULL;
fs_oper.ioctl = NULL;
fs_oper.flock = NULL;
fs_oper.lseek = NULL;
fs_oper.access = NULL;
fs_oper.write_buf = NULL;
fs_oper.read_buf = NULL;
fs_oper.getxattr = NULL;
fs_oper.setxattr = NULL;
fs_oper.listxattr = NULL;
fs_oper.removexattr = NULL;
auto fuseMain = new FuseMain(&fs_oper);
ret = fuseMain->loop();
}
return ret;
}
int main(int argc, char *argv[])
{
QCoreApplication app(argc, argv);
app.setApplicationName(APP_NAME);
app.setApplicationVersion(APP_VER);
quint64 blkSize = DEFAULT_BLK_SIZE;
SharedData::blkSize = &blkSize;
SharedData::configPath = defaultConfig();
if (app.arguments().contains("--help") || (argc == 1))
{
return showHelp();
}
else if (app.arguments().contains("--list-db-drvs"))
{
return lsDbDrvs();
}
else if (app.arguments().contains("--config-help"))
{
return showConfigHelp();
}
else if (app.arguments().contains("--list-datasets"))
{
return lsDatasets();
}
else if (app.arguments().contains("--rm-dataset"))
{
auto posOfName = app.arguments().indexOf(QRegularExpression("--rm-dataset", QRegularExpression::CaseInsensitiveOption));
if ((posOfName + 1) < argc)
{
return rmDataset(argv[posOfName + 1]);
}
else
{
QTextStream(stderr) << "err: No valid dataset name was given." << Qt::endl; return -EINVAL;
}
}
else if (app.arguments().contains("--fork") || app.arguments().contains("--snapshot"))
{
auto posOfSrc = app.arguments().indexOf(QRegularExpression("--src", QRegularExpression::CaseInsensitiveOption));
auto posOfDst = app.arguments().indexOf(QRegularExpression("--dst", QRegularExpression::CaseInsensitiveOption));
QString src;
QString dst;
if ((posOfSrc != -1) && ((posOfSrc + 1) < argc))
{
src = argv[posOfSrc + 1];
}
else
{
QTextStream(stderr) << "err: Source dataset --src not given." << Qt::endl; return -EINVAL;
}
if ((posOfDst != -1) && ((posOfDst + 1) < argc))
{
dst = argv[posOfDst + 1];
}
else
{
QTextStream(stderr) << "err: Destination dataset --dst not given." << Qt::endl; return -EINVAL;
}
if (src.isEmpty() || dst.isEmpty())
{
QTextStream(stderr) << "err: No value was passed into --src or --dst." << Qt::endl; return -EINVAL;
}
else
{
auto ret = 0;
auto dbObj = getDbObj(ret);
if (ret == 0)
{
if (dataSetExists(dst, dbObj))
{
QTextStream(stderr) << "err: '" << dst << "' already exists." << Qt::endl; ret = -EEXIST;
}
else if (!dataSetExists(src, dbObj))
{
QTextStream(stderr) << "err: '" << src << "' does not exists." << Qt::endl; ret = -ENOENT;
}
else if (!validDataset(dst))
{
QTextStream(stderr) << "err: Invalid destination dataset name '" << dst << "'" << Qt::endl; return -EINVAL;
}
else if (app.arguments().contains("--fork"))
{
createFork(src, dst, dbObj, ret);
}
else
{
createSnapshot(src, dst, dbObj, ret);
}
}
return ret;
}
}
else if (app.arguments().contains("--run"))
{
auto posOfConfig = app.arguments().indexOf(QRegularExpression("--config", QRegularExpression::CaseInsensitiveOption));
auto posOfBlkSz = app.arguments().indexOf(QRegularExpression("--blk-size", QRegularExpression::CaseInsensitiveOption));
if ((posOfConfig != -1) && ((posOfConfig + 1) < argc))
{
SharedData::configPath = argv[posOfConfig + 1];
}
if ((posOfBlkSz != -1) && ((posOfBlkSz + 1) < argc))
{
*SharedData::blkSize = QString(argv[posOfBlkSz + 1]).toULongLong();
}
return runApp(&app);
}
else
{
return showHelp();
}
}

95
src/unix_signal.cpp Normal file
View File

@ -0,0 +1,95 @@
#include "unix_signal.h"
// This file is part of MRCI.
// MRCI is free software: you can redistribute it and/or modify
// it under the terms of the GNU General Public License as published by
// the Free Software Foundation, either version 3 of the License, or
// (at your option) any later version.
// MRCI is distributed in the hope that it will be useful,
// but WITHOUT ANY WARRANTY; without even the implied warranty of
// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
// GNU General Public License for more details.
// You should have received a copy of the GNU General Public License
// along with MRCI under the LICENSE.md file. If not, see
// <http://www.gnu.org/licenses/>.
#ifdef Q_OS_LINUX
void setupUnixSignalHandlers()
{
struct sigaction hup;
struct sigaction term;
hup.sa_handler = UnixSignalHandler::hupSignalHandler;
term.sa_handler = UnixSignalHandler::termSignalHandler;
sigemptyset(&hup.sa_mask);
sigemptyset(&term.sa_mask);
hup.sa_flags = 0;
hup.sa_flags |= SA_RESTART;
term.sa_flags |= SA_RESTART;
sigaction(SIGHUP, &hup, 0);
sigaction(SIGTERM, &term, 0);
}
int *UnixSignalHandler::sighupFd = new int[2];
int *UnixSignalHandler::sigtermFd = new int[2];
UnixSignalHandler::UnixSignalHandler(QObject *parent) : QObject(parent)
{
socketpair(AF_UNIX, SOCK_STREAM, 0, sighupFd);
socketpair(AF_UNIX, SOCK_STREAM, 0, sigtermFd);
snHup = new QSocketNotifier(sighupFd[1], QSocketNotifier::Read, this);
snTerm = new QSocketNotifier(sigtermFd[1], QSocketNotifier::Read, this);
connect(snHup, SIGNAL(activated(int)), this, SLOT(handleSigHup()));
connect(snTerm, SIGNAL(activated(int)), this, SLOT(handleSigTerm()));
}
void UnixSignalHandler::hupSignalHandler(int)
{
char chr = 1;
write(sighupFd[0], &chr, sizeof(chr));
}
void UnixSignalHandler::termSignalHandler(int)
{
char chr = 1;
write(sigtermFd[0], &chr, sizeof(chr));
}
void UnixSignalHandler::handleSigTerm()
{
snTerm->setEnabled(false);
char chr;
read(sigtermFd[1], &chr, sizeof(chr));
emit closeApp();
snTerm->setEnabled(true);
}
void UnixSignalHandler::handleSigHup()
{
snHup->setEnabled(false);
char chr;
read(sighupFd[1], &chr, sizeof(chr));
emit closeApp();
snHup->setEnabled(true);
}
#endif // Q_OS_LINUX

63
src/unix_signal.h Normal file
View File

@ -0,0 +1,63 @@
#ifndef UNIX_SIGNAL_H
#define UNIX_SIGNAL_H
// This file is part of MRCI.
// MRCI is free software: you can redistribute it and/or modify
// it under the terms of the GNU General Public License as published by
// the Free Software Foundation, either version 3 of the License, or
// (at your option) any later version.
// MRCI is distributed in the hope that it will be useful,
// but WITHOUT ANY WARRANTY; without even the implied warranty of
// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
// GNU General Public License for more details.
// You should have received a copy of the GNU General Public License
// along with MRCI under the LICENSE.md file. If not, see
// <http://www.gnu.org/licenses/>.
#include <QtGlobal>
#ifdef Q_OS_LINUX
#include <QObject>
#include <QSocketNotifier>
#include <sys/socket.h>
#include <sys/types.h>
#include <signal.h>
#include <unistd.h>
void setupUnixSignalHandlers();
class UnixSignalHandler : public QObject
{
Q_OBJECT
private:
QSocketNotifier *snHup;
QSocketNotifier *snTerm;
static int *sighupFd;
static int *sigtermFd;
public:
explicit UnixSignalHandler(QObject *parent = 0);
static void hupSignalHandler(int);
static void termSignalHandler(int);
public slots:
void handleSigHup();
void handleSigTerm();
signals:
void closeApp();
};
#endif // Q_OS_LINUX
#endif // UNIX_SIGNAL_H

5
templates/linux_run_script.sh Normal file
View File

@ -0,0 +1,5 @@
#!/bin/sh
export QTDIR=$install_dir
export QT_PLUGIN_PATH=$install_dir
export LD_LIBRARY_PATH="$install_dir/lib:\$LD_LIBRARY_PATH"
$install_dir/$app_target $1 $2 $3

4
templates/linux_uninstall.sh Normal file
View File

@ -0,0 +1,4 @@
#!/bin/sh
rm -v /usr/bin/$app_target
rm -rv $install_dir
echo "Uninstallation Complete"

3
templates/windows_uninstall.bat Normal file
View File

@ -0,0 +1,3 @@
del /f "%windir%\$app_target.exe"
rd /q /s "$install_dir"
echo "Uninstallation Complete"