Using a BSS for storing images

We’ve been using the camera in my office (http://yardcam.progarts.com) to upload images via FTP to the research server, and then they’re put into RESEARCH.BSS using a command procedure which checks for new files in the upload directory and then uses bssc.exe to load them.  The images run from 60-100k and are about a megapixel of information when expanded.

This is showing me some of the ways not to use a BSS, especially for large amounts of data.  Without the ability to have an arbitrarily deep way to [apparently] nest entities, simply navigating the BSS via CExplore or BSSExplorer is pointless.

Here’s a dump of the RESEARCH.BSS service statistics as of 2009-12-09.  I also have SVCMON recording performance stats if you’d like to see more.  At this point, with ten

-Lynne

 

RESEARCH.BSS 12/9/2009 15:10      
         
Service Info Item Value Units Rate Delta
% Disk Free Space 8.34 percent 0.00 percent/sec 0 percent
AUDIT_LEVEL 1   0.00 /sec 0
Act Msgs 1 messages 0.00 messages/sec 0 messages
Activation Status 2   0.00 /sec 0
Activation Status Desc ENABLED      
Activation Trial Days 0   0.00 /sec 0
Active Clients Count 361   1.00 /sec 0
Associated MSS RESEARCH.MSS      
Backup: Current State 0   0.00 /sec 0
Backup: Last Success Tm        
Backup: Next time to run 2.00912E+16      
CPU Time 70.7308534 second 0.00 second/sec 0 second
CPU Type 586   0.00 /sec 0
Change Update Queue Size 50 0   0.00 /sec
Comp Name FRITH      
Count Pending Audit TX 0   0.00 /sec 0
Curr Time Local 2.00912E+16      
Curr Time UTC 2.00912E+16      
Current File Load Count 0   0.00 /sec 0
Current File Update Cnt 0   0.00 /sec 0
DBS Dat Inx Files Sync’d 1   0.00 /sec
DBS Data File Clean 1   0.00 /sec 0
DBS Index File Clean 1   0.00 /sec 0
DBS Last Clean DAT time        
DBS Last Clean INX time        
DBS Mutex Reject Count 0   0.00 /sec 0
DBS Mutex Timeout Count 0   0.00 /sec 0
DCL Ver 7.3.0.5      
DDL File Time 2.00911E+16      
Database File Time 2.00912E+16      
Database sequence number 6 830 840  
Disk Capacity 100 GB 0.00 bytes/sec 0 bytes
Disk Free Space 8 535.82 MB 0.00 bytes/sec
Exe Name C:CygNetServicesBSSBss.exe      
Exe Size 1 546.34 KB 0.00 bytes/sec
Exe Time 2.00911E+16      
Exe Ver 7.3.0.5      
File Cnt 20   0.00 /sec 0
File Processing Errors 0   0.00 /sec 0
File Processing Status IDLE      
Handles 599 handles 0.00 handles/sec 0 handles
I/O Global Pending Reqs 0.206093906   0.00 /sec 0
I/O Global Tot Pend Reqs 0.207952048   0.00 /sec 0
I/O Read bytes 476.55 MB 0.00 bytes/sec 0 bytes
I/O Read count 485 787   0.00 /sec
I/O Write bytes 83.22 MB 0.00 bytes/sec 0 bytes
I/O Write count 86 184   0.00 /sec
IP Address 192.168.2.221      
IP fragments in 0 fragment 0.00 fragment/sec 0 fragment
IP reassembled pkts fail 0 packets 0.00 packets/sec 0 packets
IP reassembled pkts ok 0 packets 0.00 packets/sec 0 packets
Index File Time 2.00912E+16      
Kernel Time 31.9646049 second 0.00 second/sec 0 second
LMask ELS 3   0.00 /sec 0
LMask ELS (cfg file) 3   0.00 /sec 0
LMask File 15   0.00 /sec 0
LMask File (cfg file) 15   0.00 /sec 0
Last File Load Duration 0 second 0.00 second/sec 0 second
Last File Load Time 2.00912E+16      
Line Cnt 1 0 0  
Log Writ Errs to Log Fil 0   0.00 /sec 0
Log Writ Errs to the ELS 0   0.00 /sec 0
Log Writes to Log File 700   1.00 /sec 0
Log Writes to the ELS 5   0.00 /sec 0
Machine % CPU Usage 22.9 percent 0.00 percent/sec 0 percent
Machine CPU Kernel Time 7 462.5418365 second 0.00 second/sec
Machine CPU Time 12 770.5694621 second 0.00 second/sec
Machine CPU User Time 5 308.0276256 second 0.00 second/sec
Machine Ready Thread Cnt 0   0.00 /sec 0
Machine non-paged pool 166.04 MB 0.00 bytes/sec 0 bytes
Machine paged pool 1 79.22 MB 0.00 bytes/sec
Max Active Messages 0 messages 0.00 messages/sec 0 messages
Max Allowed Active Msgs 20 messages 0.00 messages/sec 0 messages
Max Msg Response Time 0 ms 0.00 ms/sec 0 ms
Max Serving Time 0 ms 0.00 ms/sec 0 ms
Msgs In 170 49 messages 340.00 messages/sec
Msgs Out 170 48 messages 340.00 messages/sec
Non-paged pool bytes 29.98 KB 0.00 bytes/sec 0 bytes
Notify Queue Init Time 2.00911E+16      
Num CPU’s 8   0.00 /sec 0
OS Version Win2K8 SS x64      
Page Fault count 207 162   0.00 /sec
Page File Usage 28.21 MB 0.00 bytes/sec 0 bytes
Paged pool bytes 163.61 KB 0.00 bytes/sec 0 bytes
Pages Free 16.29 GB 0.00 bytes/sec 0 bytes
Pending File Load Count 0   0.00 /sec 0
Pending File Update Cnt 0   0.00 /sec 0
Performance Monitor Snapshot Time 2.00912E+16      
Private Memory Usage 28.21 MB 0.00 bytes/sec 0 bytes
RUDP ACK packets in 170 45 packets 340.00 packets/sec
RUDP ACK packets out 170 47 packets 340.00 packets/sec
RUDP NACK packets in 0 packets 0.00 packets/sec 0 packets
RUDP NACK packets out 0 packets 0.00 packets/sec 0 packets
RUDP cancel packets in 0 packets 0.00 packets/sec 0 packets
RUDP cancel packets out 170 45 packets 340.00 packets/sec
RUDP data packets in 189 19 packets 401.00 packets/sec
RUDP data packets out 455 947 packets 872.00 packets/sec
RUDP packets CRC fail in 0 packets 0.00 packets/sec 0 packets
RUDP probe packets in 0 packets 0.00 packets/sec 0 packets
RUDP probe packets out 2 packets 0.00 packets/sec 0 packets
RUDP receive Q overflow 0   0.00 /sec 0
RUDP send Q overflow 0   0.00 /sec 0
Ram Free 5 569.66 MB 0.00 bytes/sec
Record count in database 3 314 436  
Record count in index 162 9   0.00 /sec
Repl Change Queue Count        
Repl Error Count        
Repl Error Queue Count        
Repl Error Queue Max        
Repl Local DBS Errs        
Repl Notify File Clean 1   0.00 /sec 0
Repl Poll Secs 60 second 0.00 second/sec 0 second
Repl Recv File Clean        
Repl Remote DBS Errs        
Repl Resync End Time        
Repl Resync Level 1   0.00 /sec 0
Repl Resync Queue Count        
Repl Resync Queued Time        
Repl Resync Start Time        
Repl Resyncs Finished        
Repl Resyncs Started        
Repl Source Service        
Repl exception count        
Repl last err desc        
Repl last err time        
Repl last err type        
Repl messaging errors        
Repl network errors        
Repl other errors        
Replication last error        
SRVNET_RECV_NON_RUDP 2 packets 0.00 packets/sec 0 packets
SRVNET_SEND_NON_RUDP 2 packets 0.00 packets/sec 0 packets
Seconds Until Stat Reset 0 second 0.00 second/sec 0 second
Service % CPU Usage 0.7 percent 0.00 percent/sec 0 percent
Service % CPU Usage Raw 5.61 percent 0.00 percent/sec 0 percent
Size of database file 6 989.76 MB 0.00 bytes/sec
Size of index file 64.95 MB 0.00 bytes/sec 0 bytes
Start Time Local 2.00912E+16      
Start Time UTC 2.00912E+16      
Sys % Disk Free Space 8.34 percent 0.00 percent/sec 0 percent
Sys Disk Capacity 100 GB 0.00 bytes/sec 0 bytes
Sys Disk Free Space 8 535.82 MB 0.00 bytes/sec
Sys User Disk Free Space 8 535.82 MB 0.00 bytes/sec
T.O. Stats 3 600   0.00 /sec
TCP/IP Port Number 6 2   0.00 /sec
Threads 37 threads 0.00 threads/sec 0 threads
Tmp % Disk Free Space 8.34 percent 0.00 percent/sec 0 percent
Tmp Disk Capacity 100 GB 0.00 bytes/sec 0 bytes
Tmp Disk Free Space 8 535.82 MB 0.00 bytes/sec
Tmp User Disk Free Space 8 535.82 MB 0.00 bytes/sec
Total Files Loaded 0   0.00 /sec 0
Total Files Updated 0   0.00 /sec 0
Total Loads Processed 1   0.00 /sec 0
Total Messages 0 messages 0.00 messages/sec 0 messages
Total Msg Response Time 0 ms 0.00 ms/sec 0 ms
Total Page File Usage 16.29 GB 0.00 bytes/sec 0 bytes
Total Ram 15.99 GB 0.00 bytes/sec 0 bytes
Total Serving Time 0 ms 0.00 ms/sec 0 ms
UDP Packets In 1 882 256 packets
UDP Packets In Errors 1 604 packets 0.00 packets/sec
UDP Packets In No Listen 90 826 packets 0.00 packets/sec
UDP Packets In/Out 3 191 847 packets
UDP Packets Out 1 309 591 packets
User Disk Free Space 8 535.82 MB 0.00 bytes/sec
User ID BSS      
User Time 38.7662485 second 0.00 second/sec 0 second
Virtual Memory Avail 1 897.18 MB 0.00 bytes/sec
Virtual Memory Limit 2 47.88 MB 0.00 bytes/sec
Virtual Memory Usage 150.7 MB 0.00 bytes/sec 0 bytes
Windows User ID NT AUTHORITYSYSTEM      
Working Set Usage 32.96 MB 0.00 bytes/sec 0 bytes