As posted in a previous thread, people have been banging away at various wolf file formats at xentax.com, the first tool by Csimbi was for the global decls format, which let me pull a couple of files and to switch off that system :p

Another major format is stream packs (.mpk,.spk), which pretty much store everything heh.
Anyway, asmxtx has a tool here:
http://forum.xentax.com/viewtopic.php?f ... &start=148

It seems to do good, however some of his file extensions are wrong, and others incomplete.

Edit: Bellox also has a tool with gui here: http://www.daedalus-tools.mx.tc/, you can see his post in this thread.

Now for recurring frustration, the xentax forums require an admin to activate your account when you registered, and from what I hear that happening is neither constant or punctual, so despite having register a few days ago I can't post.
Beyond the fact that I can't thank Csimbi and asmxtx , I also can't post the correct and complete the file extension information that asmxtx hasn't been able to.

So here's the corrections, completions and information.

.!!!AASS!!! = .aas28
Our old friend aas files, there's only one type in Wolf, and are based on a 28x28x24 bounding box.
Confirmation: assets.pk4/def/ai/aas.def, and the aas file itself contains:
fileExtension = "aas28"
Nice.

.entities = .emap
It seems asmxtx took the wrong pointers from WolfMP which is based on the ETQW branch of idTech4, even though it does have some tech merged from wolf sp, mainly the md5r model format, it's apparent the the entities are different file formats. WolfMPs is ascii (same as etqw), Wolf sp is binary (the file even contain the text "binary entities" ).
Confirmation: The console points out - "loaded .map file maps/game/trainyard/trainyard.emap" etc.

.!!!HKXA!!! = ??
In one of the files - hkaAnimationContainer
.!!!HKXR!!! = ??
In one of the files - hkaRagdollInstance
.!!!HKXS!!! = ??
Somewhat of a mystery, if not for below I'd assume skeleton, looking at it's references to shapes and physics I'm guessing it's the collision model for havok.
.!!!SKEL!!! = ???
Assuming skeleton for animated models from the name, looking at file it is havok data.

All of the above referenced via same .hkx (except .skel) in .def files, which correspond to label in stream pack for each chunk that corresponds to the seperate .hkxwhatever files.
example "models/characters/_humanoid_male/humanoid_male.hkx", these are referenced for anims, clipmodels and skeletons. Havok data seems to have taken over some of the idTech4 stuff, md5anim, collision model.
I assume .hkx is a format that contains all of the above havok data, but in this case is split for file streamer.

.MD5R
Yes, Ravens evolution of MD5mesh, Wolf MP seems to have inherited this format, no doubt for ease of transfer of assets from SP to MP.

.procb = .proc (unshure)
.procb is definately for WolfMP, inherited from ETQW proc binary, however looking at the two file formats we see an amusing reversal of the entities situation, wolf sp proc is ascii.
The file contains:
MD5RProcVersion 7
also
file "hospital_vb1.MD5RBin" - many references to different md5rbins
Seems a great advancment off idTech4s .proc files, instead of including models within the proc as ascii it references a md5rbin.
So, extension? Who knows, I'm guessing still .proc

====
AAS Musings.
With most humanoid in wolf, using the 28x28 would be fine, but you see it running into troubles with the sniffers and the particle cannon soldiers - don't quote me on that though (yet), i'd have to take a closer look.
Doom 3s smallest aas bounds is 48x48x82, Quake4s 32x32x79, Qwars is 32x32x79
I guess the closer size is to get close cover points - I haven't checked the actual bounds of any of the actors yet.
The low z bound (24) is obviously for the few spots where sniffers come out of crawlspaces, but again it's a potential for navigation troubles.
It's really a trade off for aas sizes that fit the majority of your actors bounds and the amount of memory you want to spend, each new aas type is a new aas map.

Are the folks over there documenting the specifications for these archive types or distributing their tools as open source? Also, has anyone tried these console commands...

www.modwiki.net wrote:

compileStreamPack compiles a single stream pack/asl file
compileStreamPacks compiles all stream pack/asl files in a given dir tree

It might be possible to roll your own packs via the console.

Also linked in that forum post is another tool, written in C# and released as GPL - see here: http://daedalus-tools.mx.tc/. Looks much more user friendly than the DOS mode thing the other guy has done

Interesting- any idea what md5r adds to the format? I get the impression there's LOD models packed in now?

TinMan, I can't say anything for sure, but I believe that the files in the assets.pk4 are incomplete/different and are not the latest files like those that are in the stream packs, so I wouldn't assume things like only one aas size and things like that. I get this from the fact that a lot of the entities in the defs (mainly triggers and targets) are invalid and cannot be spawned. My guess is the assets.pk4 is probably something the should have been removed or is a placeholder of some kind for when/if the sdk comes out giving us the full assets.pk4. Or I might be completely wrong.

Thanks Rich, Anthony, one of my weaknesses is I often skim over some things that I should have noted for further investigation. Anyhoo I've sent an email the that tools guy.
I'll poke away at the tool source, I haven't really done any file format stuff before (having being insulated it by having most of my programming done in the confines of idtech4), but it is something I want to rectify and this at least is a starting example.
I'll have a poke at compileStreamPack when I have a chance too.

Sikkpin:
The ones that can't be spawned seem to be due to the spawn packs with the assets not being loaded, you can test this by spawning stuff that doesn't load in one map in a another where that entity has an instance due to being placed in a map.
I do agree with some files not being in assets though, they are likely in the .decls files in the map streampacks.
And from the few files I've checked from a extracted globals.decls the decls in assets.pk4 are the same.
Also with the current state of the .decls extraction tool I can't really confirm if there's some more files in that that aren't in assets.pk4, the fonts files were a lucky break in a sense.

hi
@TinMan i'm glad at least one person knows some of these mysterious file extensions, i'll correct them in my tool @ http://daedalus-tools.mx.tc/
thx

because of the spk/mpk file format: each file starts with a magic number (4 bytes), then come 1-n chunks...

each chunk consists of a magic number referring to the format (4 bytes), the uncompressed size (4 bytes), the compressed size (4 bytes) and then a zlib-compressed block (sizes only refer to this block)...

each block (uncompressed) contains a file table and then the files:
the file table contains a bunch of 0-terminated strings (path + filename) and after each string 2x the size of the corresponding file (2x 4 bytes)

the files themselves are always aligned to 4-byte boundaries, the padding bytes are somehow not always 0, which i dont understand :-(

if you run into trouble, look in my sourcecode ;-)

hope i got everything right

hope it helps, enjoy

Thanks bellox, was just looking through your source now, big points for the references to modwiki

Also
BRAI = .brain
referenced in various defs
"brain" "common/cinematic_trigger.brain"
It's looking like a graph (again with disclaimer of little experiece with different file formats) for the previously guessed at behaviour tree/task network.

PBBF
This is an odd one, you are giving them md5rbin extension, it seems right, the filenames seem to match those in .proc
On the flipside there's mention of playback files, which would match the magic number, various mentions of playback in console cvars and cmds. "listPlaybacks lists playback decls".
This system was also in Quake 4 but I never looked at the system myself.
http://www.modwiki.net/wiki/PLAYBACK_%28file_format%29
It certainly doesn't seem to be what's output anyhoo.
I can't find evidence of playbacks being used/referenced however.
One theory they stopped using it at some point and just reused the magic number for md5rbin without renaming it, odd but the only thing I can think of to explain it.

DECL = .decls
As seen is assets.pk4/maps/game/global/
This is a compilation of a lot of different decl files.
As mentioned, Csimbi made a tool for this, but I was hoping for an improved version as his outputs in a way that can rebuild the .decls (which we don't really need imho), rather than in a way that can be worked with.

I'll have to get up all my poking and prodding onto modwiki
Rich, looks like you were having a rough time with spammers

TinMan wrote:

Rich, looks like you were having a rough time with spammers

I did but not anymore. I spent the last two weeks or so writing a Python bot to screen scrape the recent changes list, determine which new articles are spam, present me with the results, and then wait for my confirmation before taking action.

This morning at 4:48am an anti-spam bot was born...

http://www.modwiki.net/w/index.php?title=Special:Recentchanges&hidebots=0

... and as you can see, PyBot is doing his new job very well. :twisted:

is there a way to extract - hear the sounds files , spk files ?
I would like to mod the game so that the nazis npc speak german.
I mean only for the german soldiers during fights, I think it would add to the atmosphere ..

pretty much like crysis on delta difficulty where the koreans actually speaks korean
allies and everything else remains english.
I already have the germans speech files, problem is I have to go through every sound file to discover which files are for npc only ...

nevermind Bellox tool is working pretty well, thanx Bellox !
now I have to test it, let me know if interest is there, I might upload it here once I am done with it ...

@vertex007 of course i'm interested, i'm think these english tracks with german accent sound entirely stupid ;-)

Hi. I just wanted to say thanks for the unpacker bellox902, it was very useful and simple to use. Have you considered a re-packer at all, or is that not possible with the available information?

vertex007: Sound like a cool idea :mrgreen:

Megazoid wrote:

Have you considered a re-packer at all, or is that not possible with the available information?

yes a re-packer would be great, I was working on that language mod and was like 80% done but due to the structure of some spk content I can´t really finish it properly without a working repacker.
so far it is working good but then suddenly the germans start to speak english again on some maps/situations things get mixed up ...

i'll see what i can do, but i'll need a little time

blah

hi
@vertex007 ok, i tried to add packing functionality for mp3 files, but i have only tested it with one sound file in the game, so if you have any trouble, let me know
greetings, enjoy

thanks bellox902 for the update !
I just ran your mp3 packer and it seems to work flawlessly !
good job !

now I can complete the mod

thanks again

to bellox902, Megazoid and all whom it may concern, the Language mod is now completed and can be downloaded here:

viewtopic.php?f=68&t=23136

see Language Pack

enjoy

good job double-o-seven

Nice job vertex007, I've added a mirror for your language pack here: http://www.wolfedit.com/files/wolf/mods/mods.html

@bellox902 : Would it be possible to create a re-packer for the textures ( dds) files also ? This way we could create our own skin mods or even change the whole atmosphere of the game...

thanks FireFly

I just checked your mirrors, Language Pack is ok but if you click on Wolf Redux you get Risk a4 instead, just saying ..
also if you click on Forums from the download site you get an Error 404.
but cool site you got there, keep up the good work !
cheers

Errors should be fixed now :oops:

Thanks for the feedback.

perfect !
no problem, mate, shit happens !
thanks again for the mirrors

hi
@FireFly wow, you people here are really ambitious, but i'll see what i can do :-)

I think repacking textures might not be that easy, since the spk/mpk-files that contain textures also contain other chunks.
The best solution would probably be to unpack the raw chunks, only modify the necessary ones and repack them with the other chunks.
I was also thinking of making a gui which shows the images (have allready implemented dxtn decompression) so they can just be replaced in the program, this would leave less room for errors.

I have decompress a file english.spk. I make change in fonts on cz.
I need compress all files on file english. spk. Is it posible?
Can You send me any software?

thanks FireFly

I just checked your mirrors, Language Pack is ok but if you click on Wolf Redux you get Risk a4 instead, just saying ..
also if you click on Forums from the download site you get an Error 404.
but cool site you got there, keep up the good work !
cheers

Errors should be fixed now :oops:

Thanks for the feedback.

perfect !
no problem, mate, shit happens !
thanks again for the mirrors

hi
@FireFly wow, you people here are really ambitious, but i'll see what i can do :-)

I think repacking textures might not be that easy, since the spk/mpk-files that contain textures also contain other chunks.
The best solution would probably be to unpack the raw chunks, only modify the necessary ones and repack them with the other chunks.
I was also thinking of making a gui which shows the images (have allready implemented dxtn decompression) so they can just be replaced in the program, this would leave less room for errors.

I have decompress a file english.spk. I make change in fonts on cz.
I need compress all files on file english. spk. Is it posible?
Can You send me any software?

As posted in a previous thread, people have been banging away at various wolf file formats at xentax.com, the first tool by Csimbi was for the global decls format, which let me pull a couple of files and to switch off that system :p

Another major format is stream packs (.mpk,.spk), which pretty much store everything heh.
Anyway, asmxtx has a tool here:
http://forum.xentax.com/viewtopic.php?f ... &start=148

It seems to do good, however some of his file extensions are wrong, and others incomplete.

Edit: Bellox also has a tool with gui here: http://www.daedalus-tools.mx.tc/, you can see his post in this thread.

Now for recurring frustration, the xentax forums require an admin to activate your account when you registered, and from what I hear that happening is neither constant or punctual, so despite having register a few days ago I can't post.
Beyond the fact that I can't thank Csimbi and asmxtx , I also can't post the correct and complete the file extension information that asmxtx hasn't been able to.

So here's the corrections, completions and information.

.!!!AASS!!! = .aas28
Our old friend aas files, there's only one type in Wolf, and are based on a 28x28x24 bounding box.
Confirmation: assets.pk4/def/ai/aas.def, and the aas file itself contains:
fileExtension = "aas28"
Nice.

.entities = .emap
It seems asmxtx took the wrong pointers from WolfMP which is based on the ETQW branch of idTech4, even though it does have some tech merged from wolf sp, mainly the md5r model format, it's apparent the the entities are different file formats. WolfMPs is ascii (same as etqw), Wolf sp is binary (the file even contain the text "binary entities" ).
Confirmation: The console points out - "loaded .map file maps/game/trainyard/trainyard.emap" etc.

.!!!HKXA!!! = ??
In one of the files - hkaAnimationContainer
.!!!HKXR!!! = ??
In one of the files - hkaRagdollInstance
.!!!HKXS!!! = ??
Somewhat of a mystery, if not for below I'd assume skeleton, looking at it's references to shapes and physics I'm guessing it's the collision model for havok.
.!!!SKEL!!! = ???
Assuming skeleton for animated models from the name, looking at file it is havok data.

All of the above referenced via same .hkx (except .skel) in .def files, which correspond to label in stream pack for each chunk that corresponds to the seperate .hkxwhatever files.
example "models/characters/_humanoid_male/humanoid_male.hkx", these are referenced for anims, clipmodels and skeletons. Havok data seems to have taken over some of the idTech4 stuff, md5anim, collision model.
I assume .hkx is a format that contains all of the above havok data, but in this case is split for file streamer.

.MD5R
Yes, Ravens evolution of MD5mesh, Wolf MP seems to have inherited this format, no doubt for ease of transfer of assets from SP to MP.

.procb = .proc (unshure)
.procb is definately for WolfMP, inherited from ETQW proc binary, however looking at the two file formats we see an amusing reversal of the entities situation, wolf sp proc is ascii.
The file contains:
MD5RProcVersion 7
also
file "hospital_vb1.MD5RBin" - many references to different md5rbins
Seems a great advancment off idTech4s .proc files, instead of including models within the proc as ascii it references a md5rbin.
So, extension? Who knows, I'm guessing still .proc

====
AAS Musings.
With most humanoid in wolf, using the 28x28 would be fine, but you see it running into troubles with the sniffers and the particle cannon soldiers - don't quote me on that though (yet), i'd have to take a closer look.
Doom 3s smallest aas bounds is 48x48x82, Quake4s 32x32x79, Qwars is 32x32x79
I guess the closer size is to get close cover points - I haven't checked the actual bounds of any of the actors yet.
The low z bound (24) is obviously for the few spots where sniffers come out of crawlspaces, but again it's a potential for navigation troubles.
It's really a trade off for aas sizes that fit the majority of your actors bounds and the amount of memory you want to spend, each new aas type is a new aas map.

Are the folks over there documenting the specifications for these archive types or distributing their tools as open source? Also, has anyone tried these console commands...

www.modwiki.net wrote:

compileStreamPack compiles a single stream pack/asl file
compileStreamPacks compiles all stream pack/asl files in a given dir tree

It might be possible to roll your own packs via the console.

Also linked in that forum post is another tool, written in C# and released as GPL - see here: http://daedalus-tools.mx.tc/. Looks much more user friendly than the DOS mode thing the other guy has done

Interesting- any idea what md5r adds to the format? I get the impression there's LOD models packed in now?

TinMan, I can't say anything for sure, but I believe that the files in the assets.pk4 are incomplete/different and are not the latest files like those that are in the stream packs, so I wouldn't assume things like only one aas size and things like that. I get this from the fact that a lot of the entities in the defs (mainly triggers and targets) are invalid and cannot be spawned. My guess is the assets.pk4 is probably something the should have been removed or is a placeholder of some kind for when/if the sdk comes out giving us the full assets.pk4. Or I might be completely wrong.

Thanks Rich, Anthony, one of my weaknesses is I often skim over some things that I should have noted for further investigation. Anyhoo I've sent an email the that tools guy.
I'll poke away at the tool source, I haven't really done any file format stuff before (having being insulated it by having most of my programming done in the confines of idtech4), but it is something I want to rectify and this at least is a starting example.
I'll have a poke at compileStreamPack when I have a chance too.

Sikkpin:
The ones that can't be spawned seem to be due to the spawn packs with the assets not being loaded, you can test this by spawning stuff that doesn't load in one map in a another where that entity has an instance due to being placed in a map.
I do agree with some files not being in assets though, they are likely in the .decls files in the map streampacks.
And from the few files I've checked from a extracted globals.decls the decls in assets.pk4 are the same.
Also with the current state of the .decls extraction tool I can't really confirm if there's some more files in that that aren't in assets.pk4, the fonts files were a lucky break in a sense.

hi
@TinMan i'm glad at least one person knows some of these mysterious file extensions, i'll correct them in my tool @ http://daedalus-tools.mx.tc/
thx

because of the spk/mpk file format: each file starts with a magic number (4 bytes), then come 1-n chunks...

each chunk consists of a magic number referring to the format (4 bytes), the uncompressed size (4 bytes), the compressed size (4 bytes) and then a zlib-compressed block (sizes only refer to this block)...

each block (uncompressed) contains a file table and then the files:
the file table contains a bunch of 0-terminated strings (path + filename) and after each string 2x the size of the corresponding file (2x 4 bytes)

the files themselves are always aligned to 4-byte boundaries, the padding bytes are somehow not always 0, which i dont understand :-(

if you run into trouble, look in my sourcecode ;-)

hope i got everything right

hope it helps, enjoy

Thanks bellox, was just looking through your source now, big points for the references to modwiki

Also
BRAI = .brain
referenced in various defs
"brain" "common/cinematic_trigger.brain"
It's looking like a graph (again with disclaimer of little experiece with different file formats) for the previously guessed at behaviour tree/task network.

PBBF
This is an odd one, you are giving them md5rbin extension, it seems right, the filenames seem to match those in .proc
On the flipside there's mention of playback files, which would match the magic number, various mentions of playback in console cvars and cmds. "listPlaybacks lists playback decls".
This system was also in Quake 4 but I never looked at the system myself.
http://www.modwiki.net/wiki/PLAYBACK_%28file_format%29
It certainly doesn't seem to be what's output anyhoo.
I can't find evidence of playbacks being used/referenced however.
One theory they stopped using it at some point and just reused the magic number for md5rbin without renaming it, odd but the only thing I can think of to explain it.

DECL = .decls
As seen is assets.pk4/maps/game/global/
This is a compilation of a lot of different decl files.
As mentioned, Csimbi made a tool for this, but I was hoping for an improved version as his outputs in a way that can rebuild the .decls (which we don't really need imho), rather than in a way that can be worked with.

I'll have to get up all my poking and prodding onto modwiki
Rich, looks like you were having a rough time with spammers

TinMan wrote:

Rich, looks like you were having a rough time with spammers

I did but not anymore. I spent the last two weeks or so writing a Python bot to screen scrape the recent changes list, determine which new articles are spam, present me with the results, and then wait for my confirmation before taking action.

This morning at 4:48am an anti-spam bot was born...

http://www.modwiki.net/w/index.php?title=Special:Recentchanges&hidebots=0

... and as you can see, PyBot is doing his new job very well. :twisted:

is there a way to extract - hear the sounds files , spk files ?
I would like to mod the game so that the nazis npc speak german.
I mean only for the german soldiers during fights, I think it would add to the atmosphere ..

pretty much like crysis on delta difficulty where the koreans actually speaks korean
allies and everything else remains english.
I already have the germans speech files, problem is I have to go through every sound file to discover which files are for npc only ...

nevermind Bellox tool is working pretty well, thanx Bellox !
now I have to test it, let me know if interest is there, I might upload it here once I am done with it ...

@vertex007 of course i'm interested, i'm think these english tracks with german accent sound entirely stupid ;-)

Hi. I just wanted to say thanks for the unpacker bellox902, it was very useful and simple to use. Have you considered a re-packer at all, or is that not possible with the available information?

vertex007: Sound like a cool idea :mrgreen:

Megazoid wrote:

Have you considered a re-packer at all, or is that not possible with the available information?

yes a re-packer would be great, I was working on that language mod and was like 80% done but due to the structure of some spk content I can´t really finish it properly without a working repacker.
so far it is working good but then suddenly the germans start to speak english again on some maps/situations things get mixed up ...

i'll see what i can do, but i'll need a little time

blah

hi
@vertex007 ok, i tried to add packing functionality for mp3 files, but i have only tested it with one sound file in the game, so if you have any trouble, let me know
greetings, enjoy

thanks bellox902 for the update !
I just ran your mp3 packer and it seems to work flawlessly !
good job !

now I can complete the mod

thanks again

to bellox902, Megazoid and all whom it may concern, the Language mod is now completed and can be downloaded here:

viewtopic.php?f=68&t=23136

see Language Pack

enjoy

good job double-o-seven

Nice job vertex007, I've added a mirror for your language pack here: http://www.wolfedit.com/files/wolf/mods/mods.html

@bellox902 : Would it be possible to create a re-packer for the textures ( dds) files also ? This way we could create our own skin mods or even change the whole atmosphere of the game...

thanks FireFly

I just checked your mirrors, Language Pack is ok but if you click on Wolf Redux you get Risk a4 instead, just saying ..
also if you click on Forums from the download site you get an Error 404.
but cool site you got there, keep up the good work !
cheers

Errors should be fixed now :oops:

Thanks for the feedback.

perfect !
no problem, mate, shit happens !
thanks again for the mirrors

hi
@FireFly wow, you people here are really ambitious, but i'll see what i can do :-)

I think repacking textures might not be that easy, since the spk/mpk-files that contain textures also contain other chunks.
The best solution would probably be to unpack the raw chunks, only modify the necessary ones and repack them with the other chunks.
I was also thinking of making a gui which shows the images (have allready implemented dxtn decompression) so they can just be replaced in the program, this would leave less room for errors.

I have decompress a file english.spk. I make change in fonts on cz.
I need compress all files on file english. spk. Is it posible?
Can You send me any software?

thanks FireFly

I just checked your mirrors, Language Pack is ok but if you click on Wolf Redux you get Risk a4 instead, just saying ..
also if you click on Forums from the download site you get an Error 404.
but cool site you got there, keep up the good work !
cheers

Errors should be fixed now :oops:

Thanks for the feedback.

perfect !
no problem, mate, shit happens !
thanks again for the mirrors

hi
@FireFly wow, you people here are really ambitious, but i'll see what i can do :-)

I think repacking textures might not be that easy, since the spk/mpk-files that contain textures also contain other chunks.
The best solution would probably be to unpack the raw chunks, only modify the necessary ones and repack them with the other chunks.
I was also thinking of making a gui which shows the images (have allready implemented dxtn decompression) so they can just be replaced in the program, this would leave less room for errors.

I have decompress a file english.spk. I make change in fonts on cz.
I need compress all files on file english. spk. Is it posible?
Can You send me any software?

As posted in a previous thread, people have been banging away at various wolf file formats at xentax.com, the first tool by Csimbi was for the global decls format, which let me pull a couple of files and to switch off that system :p

Another major format is stream packs (.mpk,.spk), which pretty much store everything heh.
Anyway, asmxtx has a tool here:
http://forum.xentax.com/viewtopic.php?f ... &start=148

It seems to do good, however some of his file extensions are wrong, and others incomplete.

Edit: Bellox also has a tool with gui here: http://www.daedalus-tools.mx.tc/, you can see his post in this thread.

Now for recurring frustration, the xentax forums require an admin to activate your account when you registered, and from what I hear that happening is neither constant or punctual, so despite having register a few days ago I can't post.
Beyond the fact that I can't thank Csimbi and asmxtx , I also can't post the correct and complete the file extension information that asmxtx hasn't been able to.

So here's the corrections, completions and information.

.!!!AASS!!! = .aas28
Our old friend aas files, there's only one type in Wolf, and are based on a 28x28x24 bounding box.
Confirmation: assets.pk4/def/ai/aas.def, and the aas file itself contains:
fileExtension = "aas28"
Nice.

.entities = .emap
It seems asmxtx took the wrong pointers from WolfMP which is based on the ETQW branch of idTech4, even though it does have some tech merged from wolf sp, mainly the md5r model format, it's apparent the the entities are different file formats. WolfMPs is ascii (same as etqw), Wolf sp is binary (the file even contain the text "binary entities" ).
Confirmation: The console points out - "loaded .map file maps/game/trainyard/trainyard.emap" etc.

.!!!HKXA!!! = ??
In one of the files - hkaAnimationContainer
.!!!HKXR!!! = ??
In one of the files - hkaRagdollInstance
.!!!HKXS!!! = ??
Somewhat of a mystery, if not for below I'd assume skeleton, looking at it's references to shapes and physics I'm guessing it's the collision model for havok.
.!!!SKEL!!! = ???
Assuming skeleton for animated models from the name, looking at file it is havok data.

All of the above referenced via same .hkx (except .skel) in .def files, which correspond to label in stream pack for each chunk that corresponds to the seperate .hkxwhatever files.
example "models/characters/_humanoid_male/humanoid_male.hkx", these are referenced for anims, clipmodels and skeletons. Havok data seems to have taken over some of the idTech4 stuff, md5anim, collision model.
I assume .hkx is a format that contains all of the above havok data, but in this case is split for file streamer.

.MD5R
Yes, Ravens evolution of MD5mesh, Wolf MP seems to have inherited this format, no doubt for ease of transfer of assets from SP to MP.

.procb = .proc (unshure)
.procb is definately for WolfMP, inherited from ETQW proc binary, however looking at the two file formats we see an amusing reversal of the entities situation, wolf sp proc is ascii.
The file contains:
MD5RProcVersion 7
also
file "hospital_vb1.MD5RBin" - many references to different md5rbins
Seems a great advancment off idTech4s .proc files, instead of including models within the proc as ascii it references a md5rbin.
So, extension? Who knows, I'm guessing still .proc

====
AAS Musings.
With most humanoid in wolf, using the 28x28 would be fine, but you see it running into troubles with the sniffers and the particle cannon soldiers - don't quote me on that though (yet), i'd have to take a closer look.
Doom 3s smallest aas bounds is 48x48x82, Quake4s 32x32x79, Qwars is 32x32x79
I guess the closer size is to get close cover points - I haven't checked the actual bounds of any of the actors yet.
The low z bound (24) is obviously for the few spots where sniffers come out of crawlspaces, but again it's a potential for navigation troubles.
It's really a trade off for aas sizes that fit the majority of your actors bounds and the amount of memory you want to spend, each new aas type is a new aas map.

Are the folks over there documenting the specifications for these archive types or distributing their tools as open source? Also, has anyone tried these console commands...

www.modwiki.net wrote:

compileStreamPack compiles a single stream pack/asl file
compileStreamPacks compiles all stream pack/asl files in a given dir tree

It might be possible to roll your own packs via the console.

Also linked in that forum post is another tool, written in C# and released as GPL - see here: http://daedalus-tools.mx.tc/. Looks much more user friendly than the DOS mode thing the other guy has done

Interesting- any idea what md5r adds to the format? I get the impression there's LOD models packed in now?

TinMan, I can't say anything for sure, but I believe that the files in the assets.pk4 are incomplete/different and are not the latest files like those that are in the stream packs, so I wouldn't assume things like only one aas size and things like that. I get this from the fact that a lot of the entities in the defs (mainly triggers and targets) are invalid and cannot be spawned. My guess is the assets.pk4 is probably something the should have been removed or is a placeholder of some kind for when/if the sdk comes out giving us the full assets.pk4. Or I might be completely wrong.

Thanks Rich, Anthony, one of my weaknesses is I often skim over some things that I should have noted for further investigation. Anyhoo I've sent an email the that tools guy.
I'll poke away at the tool source, I haven't really done any file format stuff before (having being insulated it by having most of my programming done in the confines of idtech4), but it is something I want to rectify and this at least is a starting example.
I'll have a poke at compileStreamPack when I have a chance too.

Sikkpin:
The ones that can't be spawned seem to be due to the spawn packs with the assets not being loaded, you can test this by spawning stuff that doesn't load in one map in a another where that entity has an instance due to being placed in a map.
I do agree with some files not being in assets though, they are likely in the .decls files in the map streampacks.
And from the few files I've checked from a extracted globals.decls the decls in assets.pk4 are the same.
Also with the current state of the .decls extraction tool I can't really confirm if there's some more files in that that aren't in assets.pk4, the fonts files were a lucky break in a sense.

hi
@TinMan i'm glad at least one person knows some of these mysterious file extensions, i'll correct them in my tool @ http://daedalus-tools.mx.tc/
thx

because of the spk/mpk file format: each file starts with a magic number (4 bytes), then come 1-n chunks...

each chunk consists of a magic number referring to the format (4 bytes), the uncompressed size (4 bytes), the compressed size (4 bytes) and then a zlib-compressed block (sizes only refer to this block)...

each block (uncompressed) contains a file table and then the files:
the file table contains a bunch of 0-terminated strings (path + filename) and after each string 2x the size of the corresponding file (2x 4 bytes)

the files themselves are always aligned to 4-byte boundaries, the padding bytes are somehow not always 0, which i dont understand :-(

if you run into trouble, look in my sourcecode ;-)

hope i got everything right

hope it helps, enjoy

Thanks bellox, was just looking through your source now, big points for the references to modwiki

Also
BRAI = .brain
referenced in various defs
"brain" "common/cinematic_trigger.brain"
It's looking like a graph (again with disclaimer of little experiece with different file formats) for the previously guessed at behaviour tree/task network.

PBBF
This is an odd one, you are giving them md5rbin extension, it seems right, the filenames seem to match those in .proc
On the flipside there's mention of playback files, which would match the magic number, various mentions of playback in console cvars and cmds. "listPlaybacks lists playback decls".
This system was also in Quake 4 but I never looked at the system myself.
http://www.modwiki.net/wiki/PLAYBACK_%28file_format%29
It certainly doesn't seem to be what's output anyhoo.
I can't find evidence of playbacks being used/referenced however.
One theory they stopped using it at some point and just reused the magic number for md5rbin without renaming it, odd but the only thing I can think of to explain it.

DECL = .decls
As seen is assets.pk4/maps/game/global/
This is a compilation of a lot of different decl files.
As mentioned, Csimbi made a tool for this, but I was hoping for an improved version as his outputs in a way that can rebuild the .decls (which we don't really need imho), rather than in a way that can be worked with.

I'll have to get up all my poking and prodding onto modwiki
Rich, looks like you were having a rough time with spammers

TinMan wrote:

Rich, looks like you were having a rough time with spammers

I did but not anymore. I spent the last two weeks or so writing a Python bot to screen scrape the recent changes list, determine which new articles are spam, present me with the results, and then wait for my confirmation before taking action.

This morning at 4:48am an anti-spam bot was born...

http://www.modwiki.net/w/index.php?title=Special:Recentchanges&hidebots=0

... and as you can see, PyBot is doing his new job very well. :twisted:

is there a way to extract - hear the sounds files , spk files ?
I would like to mod the game so that the nazis npc speak german.
I mean only for the german soldiers during fights, I think it would add to the atmosphere ..

pretty much like crysis on delta difficulty where the koreans actually speaks korean
allies and everything else remains english.
I already have the germans speech files, problem is I have to go through every sound file to discover which files are for npc only ...

nevermind Bellox tool is working pretty well, thanx Bellox !
now I have to test it, let me know if interest is there, I might upload it here once I am done with it ...

@vertex007 of course i'm interested, i'm think these english tracks with german accent sound entirely stupid ;-)

Hi. I just wanted to say thanks for the unpacker bellox902, it was very useful and simple to use. Have you considered a re-packer at all, or is that not possible with the available information?

vertex007: Sound like a cool idea :mrgreen:

Megazoid wrote:

Have you considered a re-packer at all, or is that not possible with the available information?

yes a re-packer would be great, I was working on that language mod and was like 80% done but due to the structure of some spk content I can´t really finish it properly without a working repacker.
so far it is working good but then suddenly the germans start to speak english again on some maps/situations things get mixed up ...

i'll see what i can do, but i'll need a little time

blah

hi
@vertex007 ok, i tried to add packing functionality for mp3 files, but i have only tested it with one sound file in the game, so if you have any trouble, let me know
greetings, enjoy

thanks bellox902 for the update !
I just ran your mp3 packer and it seems to work flawlessly !
good job !

now I can complete the mod

thanks again

to bellox902, Megazoid and all whom it may concern, the Language mod is now completed and can be downloaded here:

viewtopic.php?f=68&t=23136

see Language Pack

enjoy

good job double-o-seven

Nice job vertex007, I've added a mirror for your language pack here: http://www.wolfedit.com/files/wolf/mods/mods.html

@bellox902 : Would it be possible to create a re-packer for the textures ( dds) files also ? This way we could create our own skin mods or even change the whole atmosphere of the game...

thanks FireFly

I just checked your mirrors, Language Pack is ok but if you click on Wolf Redux you get Risk a4 instead, just saying ..
also if you click on Forums from the download site you get an Error 404.
but cool site you got there, keep up the good work !
cheers

Errors should be fixed now :oops:

Thanks for the feedback.

perfect !
no problem, mate, shit happens !
thanks again for the mirrors

hi
@FireFly wow, you people here are really ambitious, but i'll see what i can do :-)

I think repacking textures might not be that easy, since the spk/mpk-files that contain textures also contain other chunks.
The best solution would probably be to unpack the raw chunks, only modify the necessary ones and repack them with the other chunks.
I was also thinking of making a gui which shows the images (have allready implemented dxtn decompression) so they can just be replaced in the program, this would leave less room for errors.

I have decompress a file english.spk. I make change in fonts on cz.
I need compress all files on file english. spk. Is it posible?
Can You send me any software?

As posted in a previous thread, people have been banging away at various wolf file formats at xentax.com, the first tool by Csimbi was for the global decls format, which let me pull a couple of files and to switch off that system :p

Another major format is stream packs (.mpk,.spk), which pretty much store everything heh.
Anyway, asmxtx has a tool here:
http://forum.xentax.com/viewtopic.php?f ... &start=148

It seems to do good, however some of his file extensions are wrong, and others incomplete.

Edit: Bellox also has a tool with gui here: http://www.daedalus-tools.mx.tc/, you can see his post in this thread.

Now for recurring frustration, the xentax forums require an admin to activate your account when you registered, and from what I hear that happening is neither constant or punctual, so despite having register a few days ago I can't post.
Beyond the fact that I can't thank Csimbi and asmxtx , I also can't post the correct and complete the file extension information that asmxtx hasn't been able to.

So here's the corrections, completions and information.

.!!!AASS!!! = .aas28
Our old friend aas files, there's only one type in Wolf, and are based on a 28x28x24 bounding box.
Confirmation: assets.pk4/def/ai/aas.def, and the aas file itself contains:
fileExtension = "aas28"
Nice.

.entities = .emap
It seems asmxtx took the wrong pointers from WolfMP which is based on the ETQW branch of idTech4, even though it does have some tech merged from wolf sp, mainly the md5r model format, it's apparent the the entities are different file formats. WolfMPs is ascii (same as etqw), Wolf sp is binary (the file even contain the text "binary entities" ).
Confirmation: The console points out - "loaded .map file maps/game/trainyard/trainyard.emap" etc.

.!!!HKXA!!! = ??
In one of the files - hkaAnimationContainer
.!!!HKXR!!! = ??
In one of the files - hkaRagdollInstance
.!!!HKXS!!! = ??
Somewhat of a mystery, if not for below I'd assume skeleton, looking at it's references to shapes and physics I'm guessing it's the collision model for havok.
.!!!SKEL!!! = ???
Assuming skeleton for animated models from the name, looking at file it is havok data.

All of the above referenced via same .hkx (except .skel) in .def files, which correspond to label in stream pack for each chunk that corresponds to the seperate .hkxwhatever files.
example "models/characters/_humanoid_male/humanoid_male.hkx", these are referenced for anims, clipmodels and skeletons. Havok data seems to have taken over some of the idTech4 stuff, md5anim, collision model.
I assume .hkx is a format that contains all of the above havok data, but in this case is split for file streamer.

.MD5R
Yes, Ravens evolution of MD5mesh, Wolf MP seems to have inherited this format, no doubt for ease of transfer of assets from SP to MP.

.procb = .proc (unshure)
.procb is definately for WolfMP, inherited from ETQW proc binary, however looking at the two file formats we see an amusing reversal of the entities situation, wolf sp proc is ascii.
The file contains:
MD5RProcVersion 7
also
file "hospital_vb1.MD5RBin" - many references to different md5rbins
Seems a great advancment off idTech4s .proc files, instead of including models within the proc as ascii it references a md5rbin.
So, extension? Who knows, I'm guessing still .proc

====
AAS Musings.
With most humanoid in wolf, using the 28x28 would be fine, but you see it running into troubles with the sniffers and the particle cannon soldiers - don't quote me on that though (yet), i'd have to take a closer look.
Doom 3s smallest aas bounds is 48x48x82, Quake4s 32x32x79, Qwars is 32x32x79
I guess the closer size is to get close cover points - I haven't checked the actual bounds of any of the actors yet.
The low z bound (24) is obviously for the few spots where sniffers come out of crawlspaces, but again it's a potential for navigation troubles.
It's really a trade off for aas sizes that fit the majority of your actors bounds and the amount of memory you want to spend, each new aas type is a new aas map.

Are the folks over there documenting the specifications for these archive types or distributing their tools as open source? Also, has anyone tried these console commands...

www.modwiki.net wrote:

compileStreamPack compiles a single stream pack/asl file
compileStreamPacks compiles all stream pack/asl files in a given dir tree

It might be possible to roll your own packs via the console.

Also linked in that forum post is another tool, written in C# and released as GPL - see here: http://daedalus-tools.mx.tc/. Looks much more user friendly than the DOS mode thing the other guy has done

Interesting- any idea what md5r adds to the format? I get the impression there's LOD models packed in now?

TinMan, I can't say anything for sure, but I believe that the files in the assets.pk4 are incomplete/different and are not the latest files like those that are in the stream packs, so I wouldn't assume things like only one aas size and things like that. I get this from the fact that a lot of the entities in the defs (mainly triggers and targets) are invalid and cannot be spawned. My guess is the assets.pk4 is probably something the should have been removed or is a placeholder of some kind for when/if the sdk comes out giving us the full assets.pk4. Or I might be completely wrong.

Thanks Rich, Anthony, one of my weaknesses is I often skim over some things that I should have noted for further investigation. Anyhoo I've sent an email the that tools guy.
I'll poke away at the tool source, I haven't really done any file format stuff before (having being insulated it by having most of my programming done in the confines of idtech4), but it is something I want to rectify and this at least is a starting example.
I'll have a poke at compileStreamPack when I have a chance too.

Sikkpin:
The ones that can't be spawned seem to be due to the spawn packs with the assets not being loaded, you can test this by spawning stuff that doesn't load in one map in a another where that entity has an instance due to being placed in a map.
I do agree with some files not being in assets though, they are likely in the .decls files in the map streampacks.
And from the few files I've checked from a extracted globals.decls the decls in assets.pk4 are the same.
Also with the current state of the .decls extraction tool I can't really confirm if there's some more files in that that aren't in assets.pk4, the fonts files were a lucky break in a sense.

hi
@TinMan i'm glad at least one person knows some of these mysterious file extensions, i'll correct them in my tool @ http://daedalus-tools.mx.tc/
thx

because of the spk/mpk file format: each file starts with a magic number (4 bytes), then come 1-n chunks...

each chunk consists of a magic number referring to the format (4 bytes), the uncompressed size (4 bytes), the compressed size (4 bytes) and then a zlib-compressed block (sizes only refer to this block)...

each block (uncompressed) contains a file table and then the files:
the file table contains a bunch of 0-terminated strings (path + filename) and after each string 2x the size of the corresponding file (2x 4 bytes)

the files themselves are always aligned to 4-byte boundaries, the padding bytes are somehow not always 0, which i dont understand :-(

if you run into trouble, look in my sourcecode ;-)

hope i got everything right

hope it helps, enjoy

Thanks bellox, was just looking through your source now, big points for the references to modwiki

Also
BRAI = .brain
referenced in various defs
"brain" "common/cinematic_trigger.brain"
It's looking like a graph (again with disclaimer of little experiece with different file formats) for the previously guessed at behaviour tree/task network.

PBBF
This is an odd one, you are giving them md5rbin extension, it seems right, the filenames seem to match those in .proc
On the flipside there's mention of playback files, which would match the magic number, various mentions of playback in console cvars and cmds. "listPlaybacks lists playback decls".
This system was also in Quake 4 but I never looked at the system myself.
http://www.modwiki.net/wiki/PLAYBACK_%28file_format%29
It certainly doesn't seem to be what's output anyhoo.
I can't find evidence of playbacks being used/referenced however.
One theory they stopped using it at some point and just reused the magic number for md5rbin without renaming it, odd but the only thing I can think of to explain it.

DECL = .decls
As seen is assets.pk4/maps/game/global/
This is a compilation of a lot of different decl files.
As mentioned, Csimbi made a tool for this, but I was hoping for an improved version as his outputs in a way that can rebuild the .decls (which we don't really need imho), rather than in a way that can be worked with.

I'll have to get up all my poking and prodding onto modwiki
Rich, looks like you were having a rough time with spammers

TinMan wrote:

Rich, looks like you were having a rough time with spammers

I did but not anymore. I spent the last two weeks or so writing a Python bot to screen scrape the recent changes list, determine which new articles are spam, present me with the results, and then wait for my confirmation before taking action.

This morning at 4:48am an anti-spam bot was born...

http://www.modwiki.net/w/index.php?title=Special:Recentchanges&hidebots=0

... and as you can see, PyBot is doing his new job very well. :twisted:

is there a way to extract - hear the sounds files , spk files ?
I would like to mod the game so that the nazis npc speak german.
I mean only for the german soldiers during fights, I think it would add to the atmosphere ..

pretty much like crysis on delta difficulty where the koreans actually speaks korean
allies and everything else remains english.
I already have the germans speech files, problem is I have to go through every sound file to discover which files are for npc only ...

nevermind Bellox tool is working pretty well, thanx Bellox !
now I have to test it, let me know if interest is there, I might upload it here once I am done with it ...

@vertex007 of course i'm interested, i'm think these english tracks with german accent sound entirely stupid ;-)

Hi. I just wanted to say thanks for the unpacker bellox902, it was very useful and simple to use. Have you considered a re-packer at all, or is that not possible with the available information?

vertex007: Sound like a cool idea :mrgreen:

Megazoid wrote:

Have you considered a re-packer at all, or is that not possible with the available information?

yes a re-packer would be great, I was working on that language mod and was like 80% done but due to the structure of some spk content I can´t really finish it properly without a working repacker.
so far it is working good but then suddenly the germans start to speak english again on some maps/situations things get mixed up ...

i'll see what i can do, but i'll need a little time

blah

hi
@vertex007 ok, i tried to add packing functionality for mp3 files, but i have only tested it with one sound file in the game, so if you have any trouble, let me know
greetings, enjoy

thanks bellox902 for the update !
I just ran your mp3 packer and it seems to work flawlessly !
good job !

now I can complete the mod

thanks again

to bellox902, Megazoid and all whom it may concern, the Language mod is now completed and can be downloaded here:

viewtopic.php?f=68&t=23136

see Language Pack

enjoy

good job double-o-seven

Nice job vertex007, I've added a mirror for your language pack here: http://www.wolfedit.com/files/wolf/mods/mods.html

@bellox902 : Would it be possible to create a re-packer for the textures ( dds) files also ? This way we could create our own skin mods or even change the whole atmosphere of the game...

thanks FireFly

I just checked your mirrors, Language Pack is ok but if you click on Wolf Redux you get Risk a4 instead, just saying ..
also if you click on Forums from the download site you get an Error 404.
but cool site you got there, keep up the good work !
cheers

Errors should be fixed now :oops:

Thanks for the feedback.

perfect !
no problem, mate, shit happens !
thanks again for the mirrors

hi
@FireFly wow, you people here are really ambitious, but i'll see what i can do :-)

I think repacking textures might not be that easy, since the spk/mpk-files that contain textures also contain other chunks.
The best solution would probably be to unpack the raw chunks, only modify the necessary ones and repack them with the other chunks.
I was also thinking of making a gui which shows the images (have allready implemented dxtn decompression) so they can just be replaced in the program, this would leave less room for errors.

I have decompress a file english.spk. I make change in fonts on cz.
I need compress all files on file english. spk. Is it posible?
Can You send me any software?